2021-01-27T09:03:18.658 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-27T09:03:18.660 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5832985 --name kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi --lock --block --description rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} --verbose --owner scheduled_kchai@teuthology -- /tmp/teuthology-worker.48ysta2r.tmp 2021-01-27T09:03:18.688 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:03:18.749 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5832985 branch: wip-kefu-testing-2021-01-27-1353 description: rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} email: tchaikov@gmail.com first_in_suite: false job_id: '5832985' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-01-27-1353 ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 507028cb839c25d6666833702df6325fd8569096 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 507028cb839c25d6666833702df6325fd8569096 workunit: branch: wip-kefu-testing-2021-01-27-1353 sha1: 507028cb839c25d6666833702df6325fd8569096 owner: scheduled_kchai@teuthology priority: 80 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 507028cb839c25d6666833702df6325fd8569096 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-01-27-1353 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 507028cb839c25d6666833702df6325fd8569096 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master timestamp: 2021-01-27_08:19:23 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9398 2021-01-27T09:03:18.750 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa; will attempt to use it 2021-01-27T09:03:18.750 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa/tasks 2021-01-27T09:03:18.751 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-27T09:03:18.753 INFO:teuthology.task.internal:Checking packages... 2021-01-27T09:03:18.772 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '507028cb839c25d6666833702df6325fd8569096' 2021-01-27T09:03:18.772 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-27T09:03:18.773 INFO:teuthology.packaging:ref: None 2021-01-27T09:03:18.773 INFO:teuthology.packaging:tag: None 2021-01-27T09:03:18.773 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-01-27-1353 2021-01-27T09:03:18.774 INFO:teuthology.packaging:sha1: 507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:03:18.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-01-27-1353 2021-01-27T09:03:18.934 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-184-g507028cb-1focal 2021-01-27T09:03:18.934 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-27T09:03:18.950 INFO:teuthology.task.internal:no buildpackages task found 2021-01-27T09:03:18.950 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-27T09:03:19.006 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-27T09:03:19.006 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:03:19.065 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5832985'} 2021-01-27T09:03:19.085 DEBUG:teuthology.lock.ops:locked ubuntu@smithi103.front.sepia.ceph.com, ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:03:19.140 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb86fbd3ae8>, signals=[15]) 2021-01-27T09:03:19.395 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of ubuntu 20.04 2021-01-27T09:03:19.436 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 20.04 2021-01-27T09:03:19.808 INFO:teuthology.orchestra.console:Power off smithi047 2021-01-27T09:03:19.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T09:03:19.824 INFO:teuthology.orchestra.console:Power off smithi103 2021-01-27T09:03:19.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T09:03:19.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:19.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:23.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:23.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:27.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:27.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:28.190 INFO:teuthology.orchestra.console:Power off for smithi047 completed 2021-01-27T09:03:28.200 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2021-01-27T09:03:28.292 INFO:teuthology.orchestra.console:Power on smithi047 2021-01-27T09:03:28.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T09:03:28.302 INFO:teuthology.orchestra.console:Power on smithi103 2021-01-27T09:03:28.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T09:03:28.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:28.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:32.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:32.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:36.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:36.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:03:36.674 INFO:teuthology.orchestra.console:Power on for smithi047 completed 2021-01-27T09:03:36.711 INFO:teuthology.orchestra.console:Power on for smithi103 completed 2021-01-27T09:03:36.776 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2021-01-27T09:03:36.813 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2021-01-27T09:06:23.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:06:32.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:06:41.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:06:50.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:06:53.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:06:59.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:02.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:08.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:11.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:20.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:30.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:39.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:48.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:07:57.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:08:06.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:08:14.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:08:15.040 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T09:08:15.042 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T09:08:15.525 INFO:teuthology.provision.fog.smithi047:Node is ready 2021-01-27T09:08:15.526 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2021-01-27T09:08:15.532 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2021-01-27T09:08:15.533 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2021-01-27T09:08:15.583 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2021-01-27T09:08:15.583 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2021-01-27T09:08:15.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2021-01-27T09:08:15.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2021-01-27T09:08:15.697 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2021-01-27T09:08:15.714 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2021-01-27T09:08:15.728 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2021-01-27T09:08:15.730 DEBUG:teuthology.parallel:result is None 2021-01-27T09:08:43.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:08:49.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:08:55.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:01.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:07.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:13.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:13.853 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T09:09:13.854 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T09:09:14.409 INFO:teuthology.provision.fog.smithi103:Node is ready 2021-01-27T09:09:14.409 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2021-01-27T09:09:14.419 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2021-01-27T09:09:14.420 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2021-01-27T09:09:14.426 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2021-01-27T09:09:14.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2021-01-27T09:09:14.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2021-01-27T09:09:14.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2021-01-27T09:09:14.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2021-01-27T09:09:14.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2021-01-27T09:09:14.677 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2021-01-27T09:09:14.678 DEBUG:teuthology.parallel:result is None 2021-01-27T09:09:14.854 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2021-01-27T09:09:14.855 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T09:09:14.875 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2021-01-27T09:09:14.875 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T09:09:14.892 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2021-01-27T09:09:14.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:09:14.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:14.947 DEBUG:teuthology.orchestra.run.smithi103:> true 2021-01-27T09:09:15.065 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2021-01-27T09:09:15.072 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2021-01-27T09:09:15.073 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2021-01-27T09:09:15.079 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2021-01-27T09:09:15.080 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:09:15.080 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2021-01-27T09:09:15.080 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2021-01-27T09:09:15.080 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:09:15.081 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04" 2021-01-27T09:09:15.081 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:09:15.081 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:09:15.081 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:09:15.081 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:09:15.082 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal 2021-01-27T09:09:15.082 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:09:15.083 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2021-01-27T09:09:15.129 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2021-01-27T09:09:15.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:09:15.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:15.187 DEBUG:teuthology.orchestra.run.smithi047:> true 2021-01-27T09:09:15.415 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2021-01-27T09:09:15.465 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2021-01-27T09:09:15.465 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2021-01-27T09:09:15.473 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2021-01-27T09:09:15.473 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:09:15.473 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2021-01-27T09:09:15.474 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2021-01-27T09:09:15.474 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:09:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="20.04" 2021-01-27T09:09:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:09:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:09:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:09:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:09:15.476 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=focal 2021-01-27T09:09:15.476 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:09:15.476 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2021-01-27T09:09:15.492 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2021-01-27T09:09:15.530 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4FbrpdDAu6YzDcoCuk/KaSIQoerN406QWteXzY0UaezH88VVwfg3UpYQ+j5r2ZLSNMFNH44OJlgNrw2t037y/V48BSatMXhgPEiov3O2m+Wjp9WP0EnQDuutofF3sagB7aaTtYdZHzDfMux5cq2zg6Nh3Vu0Q1QE/0UftjhhMbKjLaZXRe6nOzCc5Z3+aO9w3TYk8/dRg92+K03CpUaHiOdcoUWW7l4g1biOQwx41A7i8FyjiY1lyVBhuM3hhlBnp1neJgnUUrhoJNQ1ixzAhsoEOLrFraqaJFDwes+cOQz8CBv2kHmHXuShMoFf9lBEqe0XSyeK7+vXkW4XBgz6+wDyvzt+UvOvFxk5QMKs25h09FdNMe9LX73XHrog0r1W0bzZMbLiknVN95d59dkxeazRJMuj8+bUodHSD5cnxOetBzlZPo2HuQUFRqL0WZqOHlnvlv34f7tZMvpwVhGGmIXf5GoT0gXWpctNIEtOROQWfOhCNmNI+04HZF74SmMk= smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg9gNcKIlm6wemQXpZAIKM8dPFM8BmMPzODZVEJt6EQXqDAhiz4Y6k6xQpkaylUY07hf1O+i8pgXSBGh0qjxyFZ/jDEhQhpKSFJi5WrN1SAprHd9ONAUXM8RwsBtadMoqXgT/x1juOCbZmh4noTYdQ4BETcYsS41HFyS1PEbO+3mv0D4Y/X0nxUawUeOKGr7FrnuOKlqlORJDBp2e7RSKsYALRyECxXdUdvde46LYBMBswOonowBq1flPigoO88VaXJhLZX7JIQq/UlkBsU4OHBSBPUwIjSAJNTUx/5l12Str2qPRLHpdJvo+ZKBg17XnymRZcBsEGrWgZrIZGhBahnUJngCTzo8dGbLwPZi6+YmoC6jAGVjKE8SVJSgmWixjBrkInPcY38YeW6/YU/GxJeJK5TvrDJxAxnCssqTPXvXxBF5yUYWZbgVP8hVBvCQeG1HAKHNdtEBaa9dllL7771BsMQeKsg4PmAEZ1Sx+UoU6UZhi459m71YDK8ga5aIs= 2021-01-27T09:09:15.531 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:09:15.607 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-27T09:09:15.617 INFO:teuthology.task.internal:Saving configuration 2021-01-27T09:09:15.634 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-27T09:09:16.550 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-27T09:09:16.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 09:03:19.072492', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5832985', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN+nsTEmtR19qtAT7Yd1ohaHQ0TlFVa4spyKh0fDEOtj', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi103.front.sepia.ceph.com'} 2021-01-27T09:09:16.590 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 09:03:19.072514', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5832985', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINjcqE7EeRxY05bCO4GzLL388Dm1oMuSUm7yBZOCj46E', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi047.front.sepia.ceph.com'} 2021-01-27T09:09:16.590 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-27T09:09:16.685 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-01-27T09:09:16.685 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-01-27T09:09:16.686 INFO:teuthology.run_tasks:Running task console_log... 2021-01-27T09:09:16.869 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb86fbb1bf8>, signals=[15]) 2021-01-27T09:09:16.870 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-27T09:09:16.887 INFO:teuthology.task.internal:Opening connections... 2021-01-27T09:09:16.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:09:16.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:16.944 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:09:16.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:09:17.003 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-27T09:09:17.136 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2021-01-27T09:09:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2021-01-27T09:09:17.144 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2021-01-27T09:09:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2021-01-27T09:09:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:09:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2021-01-27T09:09:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2021-01-27T09:09:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:09:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04" 2021-01-27T09:09:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:09:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:09:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:09:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:09:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal 2021-01-27T09:09:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:09:17.195 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2021-01-27T09:09:17.213 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2021-01-27T09:09:17.222 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2021-01-27T09:09:17.222 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2021-01-27T09:09:17.269 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2021-01-27T09:09:17.269 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:09:17.270 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2021-01-27T09:09:17.270 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2021-01-27T09:09:17.270 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:09:17.270 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="20.04" 2021-01-27T09:09:17.270 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:09:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:09:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:09:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:09:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=focal 2021-01-27T09:09:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:09:17.272 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2021-01-27T09:09:17.286 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-27T09:09:17.322 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-27T09:09:17.330 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-27T09:09:17.330 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2021-01-27T09:09:17.333 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2021-01-27T09:09:17.340 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-27T09:09:17.346 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-27T09:09:17.347 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2021-01-27T09:09:17.350 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2021-01-27T09:09:17.373 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-27T09:09:17.465 INFO:teuthology.run_tasks:Running task kernel... 2021-01-27T09:09:17.483 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-01-27T09:09:17.484 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-27T09:09:17.484 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2021-01-27T09:09:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:5.4.0-64-generic 2021-01-27T09:09:17.491 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.4.0-64-generic 2021-01-27T09:09:17.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2021-01-27T09:09:17.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2021-01-27T09:09:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:09:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T09:09:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T09:09:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T09:09:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [179 kB] 2021-01-27T09:09:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [786 kB] 2021-01-27T09:09:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [468 kB] 2021-01-27T09:09:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [102 kB] 2021-01-27T09:09:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [5,900 B] 2021-01-27T09:09:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T09:09:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T09:09:19.195 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [417 kB] 2021-01-27T09:09:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T09:09:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [527 kB] 2021-01-27T09:09:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [190 kB] 2021-01-27T09:09:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T09:09:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [140 kB] 2021-01-27T09:09:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.0 kB] 2021-01-27T09:09:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T09:09:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [71.9 kB] 2021-01-27T09:09:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,600 B] 2021-01-27T09:09:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T09:09:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T09:09:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T09:09:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T09:09:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T09:09:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T09:09:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 5,270 kB in 2s (3,347 kB/s) 2021-01-27T09:09:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:09:23.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T09:09:23.645 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:09:23.796 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2021-01-27T09:09:23.797 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2021-01-27T09:09:23.873 INFO:teuthology.orchestra.run.smithi103.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T09:09:23.875 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T09:09:23.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T09:09:23.944 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:09:24.099 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2021-01-27T09:09:24.100 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2021-01-27T09:09:24.237 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2021-01-27T09:09:24.237 INFO:teuthology.orchestra.run.smithi103.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T09:09:24.238 INFO:teuthology.orchestra.run.smithi103.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T09:09:24.238 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T09:09:24.238 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2021-01-27T09:09:24.239 INFO:teuthology.orchestra.run.smithi103.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T09:09:24.239 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2021-01-27T09:09:24.239 INFO:teuthology.orchestra.run.smithi103.stdout: thermald 2021-01-27T09:09:24.267 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2021-01-27T09:09:24.267 INFO:teuthology.orchestra.run.smithi103.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T09:09:24.267 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T09:09:24.267 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T09:09:24.268 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2021-01-27T09:09:24.268 INFO:teuthology.orchestra.run.smithi103.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T09:09:24.444 INFO:teuthology.orchestra.run.smithi103.stdout:3 upgraded, 5 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:09:24.444 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 74.1 MB of archives. 2021-01-27T09:09:24.444 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T09:09:24.445 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T09:09:25.563 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T09:09:25.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T09:09:27.076 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T09:09:27.077 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T09:09:27.077 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T09:09:27.352 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T09:09:27.400 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T09:09:27.898 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 74.1 MB in 3s (23.7 MB/s) 2021-01-27T09:09:28.083 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T09:09:30.030 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T09:09:30.036 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:09:30.144 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:32.021 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T09:09:32.035 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:09:32.139 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:33.133 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T09:09:33.149 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:09:33.191 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:38.359 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:09:38.477 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:09:38.829 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:09:38.964 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:09:39.268 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T09:09:39.286 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T09:09:39.326 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T09:09:44.798 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T09:09:44.822 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:09:44.856 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:47.624 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:09:47.735 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:09:48.076 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T09:09:48.190 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:49.383 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:49.510 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T09:09:49.637 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:50.705 INFO:teuthology.orchestra.run.smithi103.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T09:09:50.706 INFO:teuthology.orchestra.run.smithi103.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T09:09:50.839 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:52.002 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T09:09:52.476 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T09:09:52.594 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:09:52.781 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T09:09:52.781 INFO:teuthology.orchestra.run.smithi103.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:10:14.480 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T09:10:14.481 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub' 2021-01-27T09:10:14.492 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:10:14.505 INFO:teuthology.orchestra.run.smithi103.stdout:Generating grub configuration file ... 2021-01-27T09:10:14.852 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T09:10:14.899 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:10:15.351 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:10:15.363 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:10:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:done 2021-01-27T09:10:18.015 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic 2021-01-27T09:10:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic 2021-01-27T09:10:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2021-01-27T09:10:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2021-01-27T09:10:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2021-01-27T09:10:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 18 2021-01-27T09:10:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T09:10:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2021-01-27T09:10:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta 2021-01-27T09:10:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.4.0.65.68 2021-01-27T09:10:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T09:10:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T09:10:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2021-01-27T09:10:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2021-01-27T09:10:18.047 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2021-01-27T09:10:18.047 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2021-01-27T09:10:18.047 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T09:10:18.048 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2021-01-27T09:10:18.055 INFO:teuthology.orchestra.run.smithi047.stdout:5.4.0-64-generic 2021-01-27T09:10:18.056 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.4.0-64-generic 2021-01-27T09:10:18.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2021-01-27T09:10:18.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2021-01-27T09:10:18.404 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T09:10:18.503 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:10:18.583 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T09:10:18.740 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [179 kB] 2021-01-27T09:10:18.801 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [468 kB] 2021-01-27T09:10:18.832 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [102 kB] 2021-01-27T09:10:18.835 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [5,900 B] 2021-01-27T09:10:18.835 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T09:10:18.840 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T09:10:18.841 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [417 kB] 2021-01-27T09:10:18.852 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [527 kB] 2021-01-27T09:10:18.869 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [71.9 kB] 2021-01-27T09:10:18.869 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,600 B] 2021-01-27T09:10:18.909 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T09:10:19.075 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T09:10:19.279 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [786 kB] 2021-01-27T09:10:19.385 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [190 kB] 2021-01-27T09:10:19.410 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T09:10:19.410 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [140 kB] 2021-01-27T09:10:19.427 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.0 kB] 2021-01-27T09:10:19.429 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T09:10:19.457 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T09:10:19.503 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T09:10:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T09:10:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T09:10:19.512 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T09:10:19.544 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T09:10:22.370 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 5,270 kB in 1s (3,820 kB/s) 2021-01-27T09:10:23.409 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:10:23.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T09:10:23.542 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:10:23.683 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2021-01-27T09:10:23.684 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2021-01-27T09:10:23.755 INFO:teuthology.orchestra.run.smithi047.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T09:10:23.757 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T09:10:23.758 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T09:10:23.822 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:10:23.982 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2021-01-27T09:10:23.983 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2021-01-27T09:10:24.124 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2021-01-27T09:10:24.125 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T09:10:24.125 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T09:10:24.125 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T09:10:24.126 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2021-01-27T09:10:24.126 INFO:teuthology.orchestra.run.smithi047.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T09:10:24.126 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2021-01-27T09:10:24.126 INFO:teuthology.orchestra.run.smithi047.stdout: thermald 2021-01-27T09:10:24.154 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2021-01-27T09:10:24.155 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T09:10:24.155 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T09:10:24.155 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T09:10:24.156 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2021-01-27T09:10:24.156 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T09:10:24.330 INFO:teuthology.orchestra.run.smithi047.stdout:3 upgraded, 5 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:10:24.331 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 74.1 MB of archives. 2021-01-27T09:10:24.331 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T09:10:24.331 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T09:10:25.391 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T09:10:25.642 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T09:10:26.846 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T09:10:26.898 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T09:10:26.898 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T09:10:27.366 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T09:10:27.385 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T09:10:27.864 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 74.1 MB in 3s (23.0 MB/s) 2021-01-27T09:10:28.034 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T09:10:29.916 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T09:10:29.922 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:10:30.021 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:31.946 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T09:10:31.960 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:10:32.055 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:33.049 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T09:10:33.066 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:10:33.107 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:37.729 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:10:37.846 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:10:38.173 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:10:38.291 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:10:38.603 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T09:10:38.621 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T09:10:38.661 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T09:10:44.053 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T09:10:44.076 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T09:10:44.119 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:46.756 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T09:10:46.918 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T09:10:47.254 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T09:10:47.397 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:48.557 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:48.683 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T09:10:48.809 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:49.914 INFO:teuthology.orchestra.run.smithi047.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T09:10:49.914 INFO:teuthology.orchestra.run.smithi047.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T09:10:50.044 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:51.196 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T09:10:51.322 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T09:10:51.482 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T09:10:51.674 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T09:10:51.674 INFO:teuthology.orchestra.run.smithi047.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:11:14.247 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T09:11:14.247 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub' 2021-01-27T09:11:14.270 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:11:14.297 INFO:teuthology.orchestra.run.smithi047.stdout:Generating grub configuration file ... 2021-01-27T09:11:14.644 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T09:11:14.677 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:11:15.075 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:11:15.087 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:11:17.865 INFO:teuthology.orchestra.run.smithi047.stdout:done 2021-01-27T09:11:18.243 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2021-01-27T09:11:18.284 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2021-01-27T09:11:18.284 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2021-01-27T09:11:18.285 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2021-01-27T09:11:18.285 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2021-01-27T09:11:18.285 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 18 2021-01-27T09:11:18.285 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T09:11:18.285 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2021-01-27T09:11:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2021-01-27T09:11:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.4.0.65.68 2021-01-27T09:11:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T09:11:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T09:11:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2021-01-27T09:11:18.287 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2021-01-27T09:11:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2021-01-27T09:11:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2021-01-27T09:11:18.287 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T09:11:18.288 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-01-27T09:11:18.288 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T09:11:18.288 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T09:11:18.289 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-01-27T09:11:18.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T09:11:18.289 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2021-01-27T09:11:18.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2021-01-27T09:11:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T09:11:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:11:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T09:11:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T09:11:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:11:20.013 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T09:11:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:11:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2021-01-27T09:11:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2021-01-27T09:11:20.306 INFO:teuthology.orchestra.run.smithi103.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T09:11:20.308 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T09:11:20.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T09:11:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:11:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2021-01-27T09:11:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2021-01-27T09:11:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T09:11:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:11:20.681 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic 2021-01-27T09:11:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic 2021-01-27T09:11:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2021-01-27T09:11:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2021-01-27T09:11:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2021-01-27T09:11:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 18 2021-01-27T09:11:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T09:11:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2021-01-27T09:11:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta 2021-01-27T09:11:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.4.0.65.68 2021-01-27T09:11:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T09:11:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T09:11:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2021-01-27T09:11:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2021-01-27T09:11:20.701 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2021-01-27T09:11:20.701 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2021-01-27T09:11:20.702 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2021-01-27T09:11:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.D2yocRzUeA 2021-01-27T09:11:20.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub/grub.cfg /tmp/tmp.D2yocRzUeA 2021-01-27T09:11:20.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.D2yocRzUeA 2021-01-27T09:11:20.761 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.D2yocRzUeA is 8KB 2021-01-27T09:11:20.778 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.D2yocRzUeA 2021-01-27T09:11:20.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T09:11:20.843 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:11:20.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T09:11:20.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T09:11:20.890 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T09:11:20.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo update-grub 2021-01-27T09:11:22.070 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2021-01-27T09:11:22.072 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:11:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2021-01-27T09:11:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T09:11:22.349 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:11:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:11:22.704 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:11:23.888 INFO:teuthology.orchestra.run.smithi103.stderr:done 2021-01-27T09:11:23.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2021-01-27T09:11:23.892 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-01-27T09:11:23.892 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T09:11:23.893 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2021-01-27T09:11:23.961 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2021-01-27T09:11:24.217 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T09:11:24.218 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:11:24.287 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T09:11:24.367 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T09:11:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:11:25.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T09:11:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:11:25.924 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2021-01-27T09:11:25.925 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2021-01-27T09:11:26.010 INFO:teuthology.orchestra.run.smithi047.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T09:11:26.012 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T09:11:26.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T09:11:26.081 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:11:26.226 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2021-01-27T09:11:26.227 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2021-01-27T09:11:26.375 INFO:teuthology.orchestra.run.smithi047.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T09:11:26.375 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:11:26.377 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2021-01-27T09:11:26.393 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2021-01-27T09:11:26.394 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2021-01-27T09:11:26.394 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2021-01-27T09:11:26.394 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2021-01-27T09:11:26.394 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 18 2021-01-27T09:11:26.394 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T09:11:26.395 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2021-01-27T09:11:26.395 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2021-01-27T09:11:26.395 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.4.0.65.68 2021-01-27T09:11:26.395 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T09:11:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T09:11:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2021-01-27T09:11:26.396 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2021-01-27T09:11:26.396 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2021-01-27T09:11:26.396 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2021-01-27T09:11:26.397 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2021-01-27T09:11:26.403 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.pNeyFkzlCV 2021-01-27T09:11:26.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.pNeyFkzlCV 2021-01-27T09:11:26.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.pNeyFkzlCV 2021-01-27T09:11:26.492 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.pNeyFkzlCV is 8KB 2021-01-27T09:11:26.547 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.pNeyFkzlCV 2021-01-27T09:11:26.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T09:11:26.611 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:11:26.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T09:11:26.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T09:11:26.650 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T09:11:26.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo update-grub 2021-01-27T09:11:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2021-01-27T09:11:27.922 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:11:27.945 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2021-01-27T09:11:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T09:11:28.190 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T09:11:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:11:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:11:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:done 2021-01-27T09:11:30.130 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2021-01-27T09:11:31.336 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-27T09:12:00.160 INFO:teuthology.misc:Re-opening connections... 2021-01-27T09:12:00.160 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:12:00.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:00.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:18.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:12:18.627 INFO:teuthology.misc:trying to connect to ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:12:18.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:18.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:37.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2021-01-27T09:12:37.063 DEBUG:teuthology.misc:waited 36.90265417098999 2021-01-27T09:12:38.064 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:12:38.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:38.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:41.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:12:41.123 INFO:teuthology.misc:trying to connect to ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:12:41.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:41.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:44.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2021-01-27T09:12:44.199 DEBUG:teuthology.misc:waited 44.038403272628784 2021-01-27T09:12:45.199 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:12:45.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:45.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:55.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:12:55.491 INFO:teuthology.misc:trying to connect to ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:12:55.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:55.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:12:58.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2021-01-27T09:12:58.567 DEBUG:teuthology.misc:waited 58.40647864341736 2021-01-27T09:12:59.567 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:12:59.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:12:59.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:02.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:13:02.627 INFO:teuthology.misc:trying to connect to ubuntu@smithi047.front.sepia.ceph.com 2021-01-27T09:13:02.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:02.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:02.741 DEBUG:teuthology.orchestra.run.smithi047:> true 2021-01-27T09:13:03.337 DEBUG:teuthology.misc:waited 63.176666021347046 2021-01-27T09:13:04.338 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:04.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:04.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:05.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:13:05.699 DEBUG:teuthology.misc:waited 65.53830742835999 2021-01-27T09:13:06.700 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:06.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:06.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:08.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:13:08.771 DEBUG:teuthology.misc:waited 68.61034870147705 2021-01-27T09:13:09.772 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:09.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:09.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:11.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:13:11.843 DEBUG:teuthology.misc:waited 71.68229579925537 2021-01-27T09:13:12.844 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:12.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:12.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:13.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2021-01-27T09:13:13.891 DEBUG:teuthology.misc:waited 73.73052334785461 2021-01-27T09:13:14.892 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:14.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:14.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:15.411 DEBUG:teuthology.orchestra.remote:No existing session 2021-01-27T09:13:15.412 DEBUG:teuthology.misc:waited 75.25161933898926 2021-01-27T09:13:16.413 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:16.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:16.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:16.445 DEBUG:teuthology.orchestra.remote:No existing session 2021-01-27T09:13:16.446 DEBUG:teuthology.misc:waited 76.28525805473328 2021-01-27T09:13:17.446 INFO:teuthology.misc:trying to connect to ubuntu@smithi103.front.sepia.ceph.com 2021-01-27T09:13:17.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:13:17.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:13:17.499 DEBUG:teuthology.orchestra.run.smithi103:> true 2021-01-27T09:13:18.151 DEBUG:teuthology.misc:waited 77.9908275604248 2021-01-27T09:13:19.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-01-27T09:13:19.152 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-65-generic"... 2021-01-27T09:13:19.153 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2021-01-27T09:13:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:5.4.0-65-generic 2021-01-27T09:13:19.160 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T09:13:19.160 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T09:13:19.161 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T09:13:19.161 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-01-27T09:13:19.161 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-65-generic"... 2021-01-27T09:13:19.161 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2021-01-27T09:13:19.168 INFO:teuthology.orchestra.run.smithi047.stdout:5.4.0-65-generic 2021-01-27T09:13:19.168 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T09:13:19.169 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T09:13:19.169 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T09:13:20.169 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-27T09:13:20.170 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T09:13:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2021-01-27T09:13:20.359 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-27T09:13:20.359 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T09:13:20.432 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2021-01-27T09:13:20.465 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-27T09:13:20.486 INFO:teuthology.task.internal:Creating test directory... 2021-01-27T09:13:20.486 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T09:13:20.489 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T09:13:20.497 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-27T09:13:20.552 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-27T09:13:20.566 INFO:teuthology.task.internal:Creating archive directory... 2021-01-27T09:13:20.567 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T09:13:20.570 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T09:13:20.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-27T09:13:20.606 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-27T09:13:20.607 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T09:13:20.610 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T09:13:20.638 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:13:20.650 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:13:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:13:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:13:20.661 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-27T09:13:20.671 INFO:teuthology.task.internal:Configuring sudo... 2021-01-27T09:13:20.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T09:13:20.696 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T09:13:20.722 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-27T09:13:20.741 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-27T09:13:20.742 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T09:13:20.744 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T09:13:20.753 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T09:13:20.803 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T09:13:20.810 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:13:20.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T09:13:20.855 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T09:13:20.862 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T09:13:20.870 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:13:20.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T09:13:20.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2021-01-27T09:13:20.936 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2021-01-27T09:13:20.993 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-27T09:13:21.003 INFO:teuthology.task.internal:Starting timer... 2021-01-27T09:13:21.003 INFO:teuthology.run_tasks:Running task pcp... 2021-01-27T09:13:21.037 INFO:teuthology.run_tasks:Running task selinux... 2021-01-27T09:13:21.051 DEBUG:teuthology.task.selinux:Excluding smithi103: OS 'ubuntu' does not support SELinux 2021-01-27T09:13:21.052 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2021-01-27T09:13:21.052 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-27T09:13:21.052 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-27T09:13:21.052 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-27T09:13:21.053 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-27T09:13:21.062 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2021-01-27T09:13:21.063 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2021-01-27T09:13:21.075 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-27T09:13:21.076 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-27T09:13:21.422 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-27T09:13:22.336 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-27T09:13:25.030 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-27T09:13:25.051 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:25 +0000 (0:00:00.073) 0:00:00.073 ***** 2021-01-27T09:13:25.065 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:25 +0000 (0:00:00.013) 0:00:00.087 ***** 2021-01-27T09:13:27.232 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi047.front.sepia.ceph.com] 2021-01-27T09:13:27.317 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:27 +0000 (0:00:02.252) 0:00:02.340 ***** 2021-01-27T09:13:27.475 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] 2021-01-27T09:13:27.562 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:27 +0000 (0:00:00.244) 0:00:02.584 ***** 2021-01-27T09:13:27.600 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-27T09:13:27.602 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:13:27.641 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:27 +0000 (0:00:00.078) 0:00:02.663 ***** 2021-01-27T09:13:27.689 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:13:27.728 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:27 +0000 (0:00:00.087) 0:00:02.750 ***** 2021-01-27T09:13:28.141 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-27T09:13:28.142 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T09:13:28.178 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.450) 0:00:03.201 ***** 2021-01-27T09:13:28.187 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T09:13:28.227 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.048) 0:00:03.249 ***** 2021-01-27T09:13:28.506 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-27T09:13:28.508 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.070198", "end": "2021-01-27 09:13:28.910660", "rc": 0, "start": "2021-01-27 09:13:28.840462", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T09:13:28.548 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.321) 0:00:03.570 ***** 2021-01-27T09:13:28.557 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.084657", "end": "2021-01-27 09:13:27.704982", "rc": 0, "start": "2021-01-27 09:13:27.620325", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T09:13:28.599 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.050) 0:00:03.621 ***** 2021-01-27T09:13:28.798 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-27T09:13:28.800 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:13:28.836 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.236) 0:00:03.858 ***** 2021-01-27T09:13:28.842 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:13:28.881 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:28 +0000 (0:00:00.044) 0:00:03.903 ***** 2021-01-27T09:13:29.602 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-27T09:13:29.605 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738808.8503673-2842050780149/source", "state": "file", "uid": 0} 2021-01-27T09:13:29.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:29 +0000 (0:00:00.767) 0:00:04.670 ***** 2021-01-27T09:13:29.655 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738808.8968394-10854528495126/source", "state": "file", "uid": 0} 2021-01-27T09:13:29.692 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:29 +0000 (0:00:00.043) 0:00:04.714 ***** 2021-01-27T09:13:30.015 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-27T09:13:30.016 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T09:13:30.018 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T09:13:30.054 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T09:13:30.056 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T09:13:30.182 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-01-27T09:13:30.193 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-27T09:13:30.356 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:30 +0000 (0:00:00.664) 0:00:05.379 ***** 2021-01-27T09:13:30.389 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:30 +0000 (0:00:00.032) 0:00:05.411 ***** 2021-01-27T09:13:31.268 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi047.front.sepia.ceph.com] 2021-01-27T09:13:31.270 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:31.320 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] 2021-01-27T09:13:31.367 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-27T09:13:31.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:31 +0000 (0:00:00.978) 0:00:06.390 ***** 2021-01-27T09:13:31.450 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:31 +0000 (0:00:00.082) 0:00:06.473 ***** 2021-01-27T09:13:31.759 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-27T09:13:31.760 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.169840", "end": "2021-01-27 09:13:31.730841", "rc": 0, "start": "2021-01-27 09:13:31.561001", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:13:31.799 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:31 +0000 (0:00:00.348) 0:00:06.821 ***** 2021-01-27T09:13:31.859 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.201858", "end": "2021-01-27 09:13:31.836871", "rc": 0, "start": "2021-01-27 09:13:31.635013", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:13:31.897 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:31 +0000 (0:00:00.098) 0:00:06.919 ***** 2021-01-27T09:13:31.945 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T09:13:31.946 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012767", "end": "2021-01-27 09:13:31.133653", "failed_when_result": false, "rc": 0, "start": "2021-01-27 09:13:31.120886", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:13:31.983 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:31 +0000 (0:00:00.086) 0:00:07.005 ***** 2021-01-27T09:13:32.011 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T09:13:32.013 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T09:13:32.049 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.065) 0:00:07.071 ***** 2021-01-27T09:13:32.055 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T09:13:32.057 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007261", "end": "2021-01-27 09:13:32.447062", "failed_when_result": false, "rc": 0, "start": "2021-01-27 09:13:32.439801", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:13:32.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.043) 0:00:07.114 ***** 2021-01-27T09:13:32.098 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T09:13:32.100 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.137 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.045) 0:00:07.160 ***** 2021-01-27T09:13:32.145 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T09:13:32.146 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T09:13:32.184 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.046) 0:00:07.206 ***** 2021-01-27T09:13:32.190 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T09:13:32.192 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.232 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.048) 0:00:07.254 ***** 2021-01-27T09:13:32.238 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T09:13:32.240 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.274 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.042) 0:00:07.296 ***** 2021-01-27T09:13:32.280 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T09:13:32.281 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.316 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.042) 0:00:07.339 ***** 2021-01-27T09:13:32.323 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.041) 0:00:07.380 ***** 2021-01-27T09:13:32.371 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T09:13:32.372 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.413 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.054) 0:00:07.435 ***** 2021-01-27T09:13:32.419 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T09:13:32.421 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.458 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.044) 0:00:07.480 ***** 2021-01-27T09:13:32.464 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-27T09:13:32.466 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.502 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.044) 0:00:07.524 ***** 2021-01-27T09:13:32.509 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T09:13:32.510 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.550 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.047) 0:00:07.572 ***** 2021-01-27T09:13:32.558 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T09:13:32.559 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.560 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ 2021-01-27T09:13:32.561 INFO:teuthology.task.ansible.out:ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.571 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.582 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.584 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:32 +0000 (0:00:00.071) 0:00:07.643 ***** 2021-01-27T09:13:32.630 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.632 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2021-01-27T09:13:32.634 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6I 2021-01-27T09:13:32.635 INFO:teuthology.task.ansible.out:nynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8 2021-01-27T09:13:32.637 INFO:teuthology.task.ansible.out:595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.645 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.647 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.657 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.659 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.669 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.670 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yu 2021-01-27T09:13:32.672 INFO:teuthology.task.ansible.out:riw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.681 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.683 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.693 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.695 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yeh 2021-01-27T09:13:32.696 INFO:teuthology.task.ansible.out:udasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.707 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.709 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.720 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.722 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.722 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUD 2021-01-27T09:13:32.724 INFO:teuthology.task.ansible.out:VmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.733 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.734 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.735 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.747 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.749 INFO:teuthology.task.ansible.out: skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.751 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.752 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.753 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.753 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFA 2021-01-27T09:13:32.755 INFO:teuthology.task.ansible.out:QtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.767 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79 2021-01-27T09:13:32.769 INFO:teuthology.task.ansible.out:c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.778 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.779 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.781 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.781 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a9 2021-01-27T09:13:32.783 INFO:teuthology.task.ansible.out:53dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.793 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.794 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.794 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.805 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.807 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.818 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.820 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d8 2021-01-27T09:13:32.821 INFO:teuthology.task.ansible.out:9bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.831 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.833 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.833 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr 2021-01-27T09:13:32.835 INFO:teuthology.task.ansible.out:3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.844 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.846 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.848 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.858 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.860 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.860 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagi 2021-01-27T09:13:32.862 INFO:teuthology.task.ansible.out:de uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.871 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.873 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.873 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.875 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.879 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.886 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.888 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.889 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.910 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5Fu 2021-01-27T09:13:32.912 INFO:teuthology.task.ansible.out:TcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.914 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.916 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.925 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.927 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.945 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.955 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.961 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.968 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.970 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.980 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.981 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.983 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.984 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.986 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.997 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:32.999 INFO:teuthology.task.ansible.out: skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.001 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.013 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.014 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:33.014 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.016 INFO:teuthology.task.ansible.out: skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.016 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.017 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:33.017 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.017 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.028 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.030 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.030 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.042 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.043 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.055 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.057 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.069 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.071 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.081 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.083 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.093 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.095 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.105 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.107 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.118 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.120 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.120 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.131 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.133 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.145 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.146 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.152 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.154 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.155 INFO:teuthology.task.ansible.out: skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.166 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.168 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.169 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop 2021-01-27T09:13:33.170 INFO:teuthology.task.ansible.out: ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.180 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.182 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.182 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.193 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.195 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.206 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.208 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.219 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.221 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.222 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.233 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.234 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.245 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.246 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.257 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.259 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.270 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.271 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.272 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.283 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.284 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.294 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.296 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.296 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.308 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.310 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.322 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.326 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.341 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.342 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.363 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.365 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.403 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.782) 0:00:08.426 ***** 2021-01-27T09:13:33.410 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.412 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.414 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.414 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.415 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansibl 2021-01-27T09:13:33.416 INFO:teuthology.task.ansible.out:e_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.428 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.429 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T09:13:33.430 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.430 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.472 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.068) 0:00:08.494 ***** 2021-01-27T09:13:33.479 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.481 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.481 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.481 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.502 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T09:13:33.504 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.542 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.069) 0:00:08.564 ***** 2021-01-27T09:13:33.578 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.036) 0:00:08.601 ***** 2021-01-27T09:13:33.584 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T09:13:33.586 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.042) 0:00:08.643 ***** 2021-01-27T09:13:33.629 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T09:13:33.666 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.045) 0:00:08.689 ***** 2021-01-27T09:13:33.673 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T09:13:33.675 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.711 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.044) 0:00:08.733 ***** 2021-01-27T09:13:33.717 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T09:13:33.719 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.052) 0:00:08.786 ***** 2021-01-27T09:13:33.769 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.806 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.042) 0:00:08.828 ***** 2021-01-27T09:13:33.812 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T09:13:33.814 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.852 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.046) 0:00:08.875 ***** 2021-01-27T09:13:33.860 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.898 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.045) 0:00:08.920 ***** 2021-01-27T09:13:33.905 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T09:13:33.912 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.943 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:33 +0000 (0:00:00.044) 0:00:08.965 ***** 2021-01-27T09:13:33.949 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-27T09:13:33.951 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.962 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.964 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:33.974 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T09:13:33.975 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi047.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.015 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.071) 0:00:09.037 ***** 2021-01-27T09:13:34.022 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.024 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.025 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.032 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.038 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.039 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.041 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi047.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.082 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.066) 0:00:09.104 ***** 2021-01-27T09:13:34.089 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.091 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.091 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.091 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.093 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.095 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.106 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.107 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.118 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.120 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.130 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.132 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.142 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.144 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.154 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.156 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.157 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.168 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.170 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.180 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.182 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.187 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.146) 0:00:09.250 ***** 2021-01-27T09:13:34.235 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.237 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.237 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.238 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.250 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.252 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.262 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.264 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.273 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.275 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.285 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.286 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.297 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.298 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.308 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.310 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.320 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.321 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.331 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.332 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.343 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.344 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.356 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.358 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.368 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.370 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.380 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.382 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:34.422 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.194) 0:00:09.445 ***** 2021-01-27T09:13:34.797 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-27T09:13:34.799 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-27T09:13:34.835 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.412) 0:00:09.857 ***** 2021-01-27T09:13:34.871 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.036) 0:00:09.894 ***** 2021-01-27T09:13:34.877 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-27T09:13:34.879 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => { "msg": "Host smithi047.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T09:13:34.915 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.044) 0:00:09.938 ***** 2021-01-27T09:13:34.922 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => { "msg": "Host smithi103.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T09:13:34.963 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:34 +0000 (0:00:00.047) 0:00:09.985 ***** 2021-01-27T09:13:34.969 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-27T09:13:34.971 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T09:13:35.010 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.047) 0:00:10.032 ***** 2021-01-27T09:13:35.017 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T09:13:35.055 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.044) 0:00:10.077 ***** 2021-01-27T09:13:35.060 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-27T09:13:35.062 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.098 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.043) 0:00:10.120 ***** 2021-01-27T09:13:35.108 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.144 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.045) 0:00:10.166 ***** 2021-01-27T09:13:35.150 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-27T09:13:35.151 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.188 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.044) 0:00:10.210 ***** 2021-01-27T09:13:35.195 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.233 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.045) 0:00:10.256 ***** 2021-01-27T09:13:35.240 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-27T09:13:35.242 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.278 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.045) 0:00:10.301 ***** 2021-01-27T09:13:35.285 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.323 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.043) 0:00:10.345 ***** 2021-01-27T09:13:35.328 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-27T09:13:35.330 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.048) 0:00:10.393 ***** 2021-01-27T09:13:35.379 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.418 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.047) 0:00:10.440 ***** 2021-01-27T09:13:35.425 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-27T09:13:35.427 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.463 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.044) 0:00:10.485 ***** 2021-01-27T09:13:35.464 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:35.470 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.044) 0:00:10.530 ***** 2021-01-27T09:13:35.513 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-27T09:13:35.515 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.550 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.042) 0:00:10.572 ***** 2021-01-27T09:13:35.557 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.596 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.046) 0:00:10.618 ***** 2021-01-27T09:13:35.602 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-27T09:13:35.604 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.640 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.044) 0:00:10.663 ***** 2021-01-27T09:13:35.647 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.687 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.046) 0:00:10.709 ***** 2021-01-27T09:13:35.693 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-27T09:13:35.694 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.729 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.042) 0:00:10.751 ***** 2021-01-27T09:13:35.737 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.775 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.046) 0:00:10.798 ***** 2021-01-27T09:13:35.782 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-27T09:13:35.783 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:35.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.050) 0:00:10.849 ***** 2021-01-27T09:13:35.834 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:35.836 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:35.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.048) 0:00:10.897 ***** 2021-01-27T09:13:35.881 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-27T09:13:35.883 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.923 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.047) 0:00:10.945 ***** 2021-01-27T09:13:35.929 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.966 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:35 +0000 (0:00:00.043) 0:00:10.988 ***** 2021-01-27T09:13:35.974 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-27T09:13:35.976 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:35.977 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:36.020 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.054) 0:00:11.043 ***** 2021-01-27T09:13:36.029 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.066 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.045) 0:00:11.089 ***** 2021-01-27T09:13:36.072 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-27T09:13:36.074 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.110 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.043) 0:00:11.132 ***** 2021-01-27T09:13:36.116 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.154 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.043) 0:00:11.176 ***** 2021-01-27T09:13:36.160 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-27T09:13:36.161 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.198 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.044) 0:00:11.220 ***** 2021-01-27T09:13:36.205 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.241 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.043) 0:00:11.264 ***** 2021-01-27T09:13:36.247 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-27T09:13:36.249 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.284 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.042) 0:00:11.306 ***** 2021-01-27T09:13:36.290 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.326 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.042) 0:00:11.349 ***** 2021-01-27T09:13:36.334 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-27T09:13:36.336 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.044) 0:00:11.393 ***** 2021-01-27T09:13:36.378 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.417 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.045) 0:00:11.439 ***** 2021-01-27T09:13:36.423 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-27T09:13:36.425 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.461 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.044) 0:00:11.483 ***** 2021-01-27T09:13:36.468 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.045) 0:00:11.529 ***** 2021-01-27T09:13:36.513 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-27T09:13:36.515 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.552 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.045) 0:00:11.575 ***** 2021-01-27T09:13:36.559 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.597 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.044) 0:00:11.619 ***** 2021-01-27T09:13:36.603 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-27T09:13:36.605 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.641 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.044) 0:00:11.664 ***** 2021-01-27T09:13:36.654 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.690 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.048) 0:00:11.712 ***** 2021-01-27T09:13:36.697 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-27T09:13:36.699 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.045) 0:00:11.758 ***** 2021-01-27T09:13:36.743 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:36.793 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.056) 0:00:11.815 ***** 2021-01-27T09:13:36.801 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:13:36.803 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.853 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.060) 0:00:11.875 ***** 2021-01-27T09:13:36.862 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.907 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.053) 0:00:11.929 ***** 2021-01-27T09:13:36.914 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-27T09:13:36.916 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:36.964 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:36 +0000 (0:00:00.057) 0:00:11.986 ***** 2021-01-27T09:13:36.979 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.019 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.054) 0:00:12.041 ***** 2021-01-27T09:13:37.029 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-27T09:13:37.030 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.074 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.054) 0:00:12.096 ***** 2021-01-27T09:13:37.082 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.128 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.054) 0:00:12.151 ***** 2021-01-27T09:13:37.136 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-27T09:13:37.137 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.179 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.050) 0:00:12.201 ***** 2021-01-27T09:13:37.188 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.050) 0:00:12.252 ***** 2021-01-27T09:13:37.235 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-27T09:13:37.238 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.272 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.042) 0:00:12.294 ***** 2021-01-27T09:13:37.277 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.322 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.045) 0:00:12.340 ***** 2021-01-27T09:13:37.329 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-27T09:13:37.331 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.380 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.062) 0:00:12.402 ***** 2021-01-27T09:13:37.396 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.437 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.056) 0:00:12.459 ***** 2021-01-27T09:13:37.442 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-27T09:13:37.444 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:37.481 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.044) 0:00:12.503 ***** 2021-01-27T09:13:37.490 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:37.527 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.046) 0:00:12.549 ***** 2021-01-27T09:13:37.533 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-27T09:13:37.535 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.574 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.047) 0:00:12.597 ***** 2021-01-27T09:13:37.581 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.619 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.044) 0:00:12.641 ***** 2021-01-27T09:13:37.627 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.666 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.046) 0:00:12.688 ***** 2021-01-27T09:13:37.674 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.711 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.045) 0:00:12.733 ***** 2021-01-27T09:13:37.717 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-27T09:13:37.719 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.755 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.044) 0:00:12.777 ***** 2021-01-27T09:13:37.762 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.804 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.048) 0:00:12.826 ***** 2021-01-27T09:13:37.810 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-27T09:13:37.811 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.858 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.054) 0:00:12.880 ***** 2021-01-27T09:13:37.865 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.866 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.911 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.052) 0:00:12.933 ***** 2021-01-27T09:13:37.917 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-27T09:13:37.919 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.957 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:37 +0000 (0:00:00.045) 0:00:12.979 ***** 2021-01-27T09:13:37.964 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:37.965 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.006 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.049) 0:00:13.028 ***** 2021-01-27T09:13:38.012 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:13:38.014 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.056 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.049) 0:00:13.078 ***** 2021-01-27T09:13:38.064 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.066 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:38.111 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.054) 0:00:13.133 ***** 2021-01-27T09:13:38.215 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:13:38.216 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.009940", "end": "2021-01-27 09:13:37.398295", "rc": 0, "start": "2021-01-27 09:13:37.388355", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T09:13:38.266 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.155) 0:00:13.288 ***** 2021-01-27T09:13:38.298 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T09:13:38.300 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.339 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.073) 0:00:13.362 ***** 2021-01-27T09:13:38.347 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:13:38.349 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.075812", "end": "2021-01-27 09:13:38.740483", "rc": 0, "start": "2021-01-27 09:13:38.664671", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T09:13:38.392 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.049) 0:00:13.411 ***** 2021-01-27T09:13:38.396 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.444 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.055) 0:00:13.466 ***** 2021-01-27T09:13:38.461 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T09:13:38.462 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.502 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.057) 0:00:13.524 ***** 2021-01-27T09:13:38.509 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:13:38.510 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.556 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.054) 0:00:13.578 ***** 2021-01-27T09:13:38.565 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-27T09:13:38.567 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.614 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.057) 0:00:13.636 ***** 2021-01-27T09:13:38.622 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-27T09:13:38.624 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.665 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.050) 0:00:13.687 ***** 2021-01-27T09:13:38.672 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:13:38.674 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.712 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.047) 0:00:13.734 ***** 2021-01-27T09:13:38.718 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T09:13:38.720 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.762 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.050) 0:00:13.785 ***** 2021-01-27T09:13:38.770 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-27T09:13:38.772 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.815 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.052) 0:00:13.838 ***** 2021-01-27T09:13:38.823 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T09:13:38.825 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.863 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.047) 0:00:13.885 ***** 2021-01-27T09:13:38.870 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T09:13:38.872 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.911 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.047) 0:00:13.933 ***** 2021-01-27T09:13:38.923 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-27T09:13:38.925 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:38.972 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:38 +0000 (0:00:00.061) 0:00:13.995 ***** 2021-01-27T09:13:38.981 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T09:13:38.983 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:39.028 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:39 +0000 (0:00:00.055) 0:00:14.050 ***** 2021-01-27T09:13:39.057 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:39.094 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:39 +0000 (0:00:00.066) 0:00:14.116 ***** 2021-01-27T09:13:39.322 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T09:13:39.324 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.209890", "end": "2021-01-27 09:13:38.500538", "rc": 0, "start": "2021-01-27 09:13:38.290648", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:39.362 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:39 +0000 (0:00:00.268) 0:00:14.385 ***** 2021-01-27T09:13:39.389 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-27T09:13:39.391 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:39.425 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:39 +0000 (0:00:00.062) 0:00:14.448 ***** 2021-01-27T09:13:39.662 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T09:13:39.664 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.099021", "end": "2021-01-27 09:13:38.843654", "rc": 0, "start": "2021-01-27 09:13:38.744633", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:39.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:39 +0000 (0:00:00.278) 0:00:14.726 ***** 2021-01-27T09:13:40.088 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T09:13:40.090 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.867953", "end": "2021-01-27 09:13:40.500347", "rc": 0, "start": "2021-01-27 09:13:39.632394", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:40.127 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:40 +0000 (0:00:00.423) 0:00:15.150 ***** 2021-01-27T09:13:40.154 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:40.195 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:40 +0000 (0:00:00.067) 0:00:15.217 ***** 2021-01-27T09:13:40.411 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T09:13:40.412 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.092834", "end": "2021-01-27 09:13:40.825220", "rc": 0, "start": "2021-01-27 09:13:40.732386", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:40.449 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:40 +0000 (0:00:00.253) 0:00:15.471 ***** 2021-01-27T09:13:43.429 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-27T09:13:43.431 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:13:43.465 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:43 +0000 (0:00:03.016) 0:00:18.488 ***** 2021-01-27T09:13:44.139 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T09:13:44.140 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:13:44.177 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.711) 0:00:19.199 ***** 2021-01-27T09:13:44.186 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-27T09:13:44.188 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:13:44.223 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.046) 0:00:19.246 ***** 2021-01-27T09:13:44.230 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-27T09:13:44.232 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:44.270 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.046) 0:00:19.293 ***** 2021-01-27T09:13:44.582 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T09:13:44.584 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T09:13:44.618 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.347) 0:00:19.640 ***** 2021-01-27T09:13:44.888 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T09:13:44.889 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:13:44.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.307) 0:00:19.948 ***** 2021-01-27T09:13:44.956 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-27T09:13:44.958 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:44.992 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:44 +0000 (0:00:00.066) 0:00:20.015 ***** 2021-01-27T09:13:45.293 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-27T09:13:45.294 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:13:45.332 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:45 +0000 (0:00:00.339) 0:00:20.355 ***** 2021-01-27T09:13:45.339 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T09:13:45.341 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T09:13:45.378 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:45 +0000 (0:00:00.045) 0:00:20.400 ***** 2021-01-27T09:13:45.677 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi047.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T09:13:45.969 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T09:13:46.023 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:13:46.063 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:46 +0000 (0:00:00.683) 0:00:21.084 ***** 2021-01-27T09:13:46.280 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:13:46.281 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T09:13:46.323 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:46 +0000 (0:00:00.261) 0:00:21.346 ***** 2021-01-27T09:13:46.440 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T09:13:46.473 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T09:13:46.474 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:13:46.510 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:46 +0000 (0:00:00.186) 0:00:21.532 ***** 2021-01-27T09:13:46.785 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:13:46.787 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T09:13:46.829 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:13:46.832 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T09:13:47.061 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:13:47.063 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T09:13:47.102 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.591) 0:00:22.124 ***** 2021-01-27T09:13:47.118 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:13:47.120 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T09:13:47.225 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T09:13:47.227 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:13:47.267 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.164) 0:00:22.289 ***** 2021-01-27T09:13:47.391 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:13:47.393 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T09:13:47.432 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.165) 0:00:22.455 ***** 2021-01-27T09:13:47.471 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T09:13:47.472 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:13:47.512 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.080) 0:00:22.535 ***** 2021-01-27T09:13:47.551 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T09:13:47.552 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.589 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.076) 0:00:22.612 ***** 2021-01-27T09:13:47.596 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:13:47.598 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T09:13:47.619 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-27T09:13:47.620 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:47.657 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.067) 0:00:22.679 ***** 2021-01-27T09:13:47.705 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T09:13:47.706 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.707 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.707 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.718 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.755 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.098) 0:00:22.778 ***** 2021-01-27T09:13:47.782 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T09:13:47.784 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:47.821 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:47 +0000 (0:00:00.065) 0:00:22.843 ***** 2021-01-27T09:13:47.860 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:13:47.861 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T09:13:48.137 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T09:13:48.187 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.365) 0:00:23.209 ***** 2021-01-27T09:13:48.225 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T09:13:48.227 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:13:48.263 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.076) 0:00:23.286 ***** 2021-01-27T09:13:48.291 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T09:13:48.293 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.327 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.063) 0:00:23.349 ***** 2021-01-27T09:13:48.356 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-27T09:13:48.357 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:48.394 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.066) 0:00:23.416 ***** 2021-01-27T09:13:48.432 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T09:13:48.434 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.443 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.454 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.456 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.508 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.113) 0:00:23.530 ***** 2021-01-27T09:13:48.517 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T09:13:48.519 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:13:48.555 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.047) 0:00:23.577 ***** 2021-01-27T09:13:48.564 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:48.613 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.058) 0:00:23.636 ***** 2021-01-27T09:13:48.888 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T09:13:48.890 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T09:13:48.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:48 +0000 (0:00:00.312) 0:00:23.949 ***** 2021-01-27T09:13:49.250 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T09:13:49.252 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T09:13:49.287 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.360) 0:00:24.309 ***** 2021-01-27T09:13:49.429 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T09:13:49.431 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T09:13:49.557 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T09:13:49.602 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.315) 0:00:24.624 ***** 2021-01-27T09:13:49.609 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T09:13:49.611 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:13:49.649 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.047) 0:00:24.671 ***** 2021-01-27T09:13:49.655 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:49.692 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.043) 0:00:24.715 ***** 2021-01-27T09:13:49.719 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T09:13:49.721 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:49.757 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.063) 0:00:24.778 ***** 2021-01-27T09:13:49.784 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-27T09:13:49.786 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:49.822 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:49 +0000 (0:00:00.065) 0:00:24.844 ***** 2021-01-27T09:13:49.970 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T09:13:49.973 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T09:13:50.012 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.190) 0:00:25.035 ***** 2021-01-27T09:13:50.158 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-27T09:13:50.159 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T09:13:50.199 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.186) 0:00:25.221 ***** 2021-01-27T09:13:50.199 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:50.322 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T09:13:50.323 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T09:13:50.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.159) 0:00:25.380 ***** 2021-01-27T09:13:50.501 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T09:13:50.503 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T09:13:50.618 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T09:13:50.658 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.299) 0:00:25.680 ***** 2021-01-27T09:13:50.684 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T09:13:50.686 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:50.722 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.063) 0:00:25.744 ***** 2021-01-27T09:13:50.748 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T09:13:50.750 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:13:50.786 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.064) 0:00:25.808 ***** 2021-01-27T09:13:50.812 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-27T09:13:50.814 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:50.849 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.063) 0:00:25.871 ***** 2021-01-27T09:13:50.867 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T09:13:50.868 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ActiveEnterTimestampMonotonic": "17970596", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target local-fs.target sysinit.target systemd-journald.socket time-sync.target var-run.mount basic.target network.target remote-fs.target systemd-tmpfiles-setup.service system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:12:58 UTC", "AssertTimestampMonotonic": "17963882", "Before": "plymouth-quit.service shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:12:58 UTC", "Co 2021-01-27T09:13:50.870 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "17963882", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "925", "ExecMainStartTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ExecMainStartTimestampMonotonic": "17970286", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 09:12:58 UTC] ; stop_time=[n/a] ; pid=925 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 09:12:58 UTC] ; stop_time=[n/a] ; pid=925 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-27T09:13:50.872 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:12:58 UTC", "InactiveExitTimestampMonotonic": "17970596", "InvocationID": "18e8b4abacd54a4e99d0a14aab4770cd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "925", "MemoryAccounting": "yes", "MemoryCurrent": "983040", "MemoryDe 2021-01-27T09:13:50.873 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:12:58 UTC", "StateChangeTimestampMonotonic": "17970596", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-27T09:13:50.875 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38341", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:13:50.912 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.062) 0:00:25.934 ***** 2021-01-27T09:13:50.940 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T09:13:50.942 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:50.976 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:50 +0000 (0:00:00.064) 0:00:25.999 ***** 2021-01-27T09:13:51.006 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-27T09:13:51.008 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.043 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.066) 0:00:26.065 ***** 2021-01-27T09:13:51.074 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T09:13:51.076 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.112 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.068) 0:00:26.134 ***** 2021-01-27T09:13:51.140 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-27T09:13:51.141 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.180 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.068) 0:00:26.203 ***** 2021-01-27T09:13:51.188 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-27T09:13:51.190 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T09:13:51.227 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.046) 0:00:26.249 ***** 2021-01-27T09:13:51.234 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-27T09:13:51.236 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.272 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.044) 0:00:26.294 ***** 2021-01-27T09:13:51.302 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T09:13:51.303 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.343 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.071) 0:00:26.365 ***** 2021-01-27T09:13:51.375 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-27T09:13:51.376 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.413 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.070) 0:00:26.435 ***** 2021-01-27T09:13:51.442 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T09:13:51.443 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:13:17 UTC", "ActiveEnterTimestampMonotonic": "16821443", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount nss-lookup.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket sysinit.target remote-fs.target -.mount network.target system.slice time-sync.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:13:17 UTC", "AssertTimestampMonotonic": "16819580", "Before": "shutdown.target plymouth-quit.service getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:13:17 UTC", "Co 2021-01-27T09:13:51.445 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16819580", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "952", "ExecMainStartTimestamp": "Wed 2021-01-27 09:13:17 UTC", "ExecMainStartTimestampMonotonic": "16821280", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 09:13:17 UTC] ; stop_time=[n/a] ; pid=952 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 09:13:17 UTC] ; stop_time=[n/a] ; pid=952 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-27T09:13:51.447 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:13:17 UTC", "InactiveExitTimestampMonotonic": "16821443", "InvocationID": "c0177b4436074d48a51b57c09dd7e5a1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "952", "MemoryAccounting": "yes", "MemoryCurrent": "933888", "MemoryDe 2021-01-27T09:13:51.448 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:13:17 UTC", "StateChangeTimestampMonotonic": "16821443", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-27T09:13:51.450 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.487 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.073) 0:00:26.509 ***** 2021-01-27T09:13:51.528 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.040) 0:00:26.550 ***** 2021-01-27T09:13:51.529 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:51.535 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-27T09:13:51.537 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.573 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.045) 0:00:26.595 ***** 2021-01-27T09:13:51.579 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T09:13:51.581 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.626 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.053) 0:00:26.649 ***** 2021-01-27T09:13:51.633 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-27T09:13:51.634 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.685 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.058) 0:00:26.707 ***** 2021-01-27T09:13:51.691 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-27T09:13:51.692 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.732 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.047) 0:00:26.755 ***** 2021-01-27T09:13:51.742 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T09:13:51.744 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:13:51.783 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.050) 0:00:26.805 ***** 2021-01-27T09:13:51.792 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T09:13:51.794 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.833 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.050) 0:00:26.855 ***** 2021-01-27T09:13:51.841 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T09:13:51.842 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T09:13:51.882 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.048) 0:00:26.904 ***** 2021-01-27T09:13:51.889 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-27T09:13:51.891 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:51.929 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.047) 0:00:26.951 ***** 2021-01-27T09:13:51.936 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T09:13:51.937 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T09:13:51.977 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:51 +0000 (0:00:00.047) 0:00:26.999 ***** 2021-01-27T09:13:51.987 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-27T09:13:51.989 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.031 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.053) 0:00:27.053 ***** 2021-01-27T09:13:52.040 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-27T09:13:52.041 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T09:13:52.080 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.049) 0:00:27.103 ***** 2021-01-27T09:13:52.087 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T09:13:52.090 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.128 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.047) 0:00:27.150 ***** 2021-01-27T09:13:52.156 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-27T09:13:52.158 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.194 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.066) 0:00:27.216 ***** 2021-01-27T09:13:52.210 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T09:13:52.212 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:13:52.253 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.058) 0:00:27.275 ***** 2021-01-27T09:13:52.255 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:52.261 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-27T09:13:52.263 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.306 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.053) 0:00:27.328 ***** 2021-01-27T09:13:52.334 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-27T09:13:52.336 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.064) 0:00:27.393 ***** 2021-01-27T09:13:52.395 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T09:13:52.396 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T09:13:52.433 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.061) 0:00:27.455 ***** 2021-01-27T09:13:52.441 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.480 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.046) 0:00:27.502 ***** 2021-01-27T09:13:52.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T09:13:52.488 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.527 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.047) 0:00:27.549 ***** 2021-01-27T09:13:52.534 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T09:13:52.535 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:13:52.571 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.043) 0:00:27.593 ***** 2021-01-27T09:13:52.577 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T09:13:52.579 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:52.615 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.044) 0:00:27.638 ***** 2021-01-27T09:13:52.622 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T09:13:52.623 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T09:13:52.661 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.045) 0:00:27.683 ***** 2021-01-27T09:13:52.699 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T09:13:52.701 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T09:13:52.737 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.075) 0:00:27.759 ***** 2021-01-27T09:13:52.764 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-27T09:13:52.766 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T09:13:52.801 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.063) 0:00:27.823 ***** 2021-01-27T09:13:52.807 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-27T09:13:52.809 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T09:13:52.845 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:52 +0000 (0:00:00.044) 0:00:27.868 ***** 2021-01-27T09:13:52.967 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T09:13:52.969 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:13:53.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.157) 0:00:28.025 ***** 2021-01-27T09:13:53.138 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T09:13:53.140 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T09:13:53.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.172) 0:00:28.198 ***** 2021-01-27T09:13:53.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T09:13:53.205 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:53.240 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.064) 0:00:28.263 ***** 2021-01-27T09:13:53.279 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T09:13:53.281 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:53.320 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.079) 0:00:28.342 ***** 2021-01-27T09:13:53.327 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T09:13:53.365 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.045) 0:00:28.387 ***** 2021-01-27T09:13:53.403 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-27T09:13:53.404 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi047"}, "changed": false} 2021-01-27T09:13:53.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.073) 0:00:28.461 ***** 2021-01-27T09:13:53.467 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-27T09:13:53.469 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T09:13:53.505 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.066) 0:00:28.528 ***** 2021-01-27T09:13:53.912 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-27T09:13:53.914 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T09:13:53.962 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:53 +0000 (0:00:00.456) 0:00:28.984 ***** 2021-01-27T09:13:53.989 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-27T09:13:53.991 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi103"}, "changed": false} 2021-01-27T09:13:54.028 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:54 +0000 (0:00:00.065) 0:00:29.050 ***** 2021-01-27T09:13:54.294 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-27T09:13:54.296 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi047.front.sepia.ceph.com", "ansible_hostname": "smithi047", "ansible_nodename": "smithi047"}, "changed": true, "name": "smithi047"} 2021-01-27T09:13:54.333 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:54 +0000 (0:00:00.304) 0:00:29.355 ***** 2021-01-27T09:13:54.341 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi103.front.sepia.ceph.com", "ansible_hostname": "smithi103", "ansible_nodename": "smithi103"}, "changed": true, "name": "smithi103"} 2021-01-27T09:13:54.342 INFO:teuthology.task.ansible.out: 2021-01-27T09:13:54.382 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:54 +0000 (0:00:00.049) 0:00:29.404 ***** 2021-01-27T09:13:54.651 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-27T09:13:54.653 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T09:13:54.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:54 +0000 (0:00:00.308) 0:00:29.713 ***** 2021-01-27T09:13:54.708 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T09:13:54.750 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:54 +0000 (0:00:00.059) 0:00:29.772 ***** 2021-01-27T09:13:55.012 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-27T09:13:55.014 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T09:13:55.052 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.301) 0:00:30.074 ***** 2021-01-27T09:13:55.070 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T09:13:55.115 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.062) 0:00:30.137 ***** 2021-01-27T09:13:55.680 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-27T09:13:55.682 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T09:13:55.723 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.608) 0:00:30.745 ***** 2021-01-27T09:13:55.745 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T09:13:55.785 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.061) 0:00:30.807 ***** 2021-01-27T09:13:55.791 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-27T09:13:55.792 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:55.833 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.048) 0:00:30.856 ***** 2021-01-27T09:13:55.842 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:55.890 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.056) 0:00:30.912 ***** 2021-01-27T09:13:55.896 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T09:13:55.898 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:55.934 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.043) 0:00:30.956 ***** 2021-01-27T09:13:55.940 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:55.978 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:55 +0000 (0:00:00.044) 0:00:31.001 ***** 2021-01-27T09:13:55.985 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T09:13:55.986 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.023 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.044) 0:00:31.045 ***** 2021-01-27T09:13:56.029 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.070 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.047) 0:00:31.092 ***** 2021-01-27T09:13:56.078 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:13:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.115 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.044) 0:00:31.137 ***** 2021-01-27T09:13:56.123 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.158 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.043) 0:00:31.180 ***** 2021-01-27T09:13:56.164 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T09:13:56.166 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.204 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.046) 0:00:31.227 ***** 2021-01-27T09:13:56.211 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.248 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.043) 0:00:31.270 ***** 2021-01-27T09:13:56.377 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.413 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.164) 0:00:31.435 ***** 2021-01-27T09:13:56.422 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.466 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.052) 0:00:31.488 ***** 2021-01-27T09:13:56.474 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:13:56.475 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.511 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.045) 0:00:31.534 ***** 2021-01-27T09:13:56.518 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.556 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.044) 0:00:31.578 ***** 2021-01-27T09:13:56.562 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T09:13:56.563 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.599 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.043) 0:00:31.621 ***** 2021-01-27T09:13:56.606 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.642 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.043) 0:00:31.665 ***** 2021-01-27T09:13:56.649 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T09:13:56.685 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.042) 0:00:31.708 ***** 2021-01-27T09:13:56.729 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.043) 0:00:31.751 ***** 2021-01-27T09:13:56.735 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T09:13:56.774 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.045) 0:00:31.796 ***** 2021-01-27T09:13:56.820 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.046) 0:00:31.843 ***** 2021-01-27T09:13:56.826 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T09:13:56.862 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.041) 0:00:31.885 ***** 2021-01-27T09:13:56.907 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.044) 0:00:31.929 ***** 2021-01-27T09:13:56.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-27T09:13:56.915 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:56.979 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:56 +0000 (0:00:00.072) 0:00:32.002 ***** 2021-01-27T09:13:56.991 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.037 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.057) 0:00:32.059 ***** 2021-01-27T09:13:57.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi047.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.046 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.047) 0:00:32.106 ***** 2021-01-27T09:13:57.091 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.093 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.129 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.045) 0:00:32.152 ***** 2021-01-27T09:13:57.135 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-27T09:13:57.137 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.177 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.047) 0:00:32.199 ***** 2021-01-27T09:13:57.184 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.222 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.045) 0:00:32.244 ***** 2021-01-27T09:13:57.228 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:13:57.230 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.272 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.050) 0:00:32.294 ***** 2021-01-27T09:13:57.279 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.318 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.045) 0:00:32.340 ***** 2021-01-27T09:13:57.325 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.364 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.046) 0:00:32.386 ***** 2021-01-27T09:13:57.372 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.408 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.044) 0:00:32.431 ***** 2021-01-27T09:13:57.416 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-27T09:13:57.417 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.454 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.045) 0:00:32.477 ***** 2021-01-27T09:13:57.461 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.499 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.044) 0:00:32.521 ***** 2021-01-27T09:13:57.505 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-27T09:13:57.507 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.543 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.043) 0:00:32.565 ***** 2021-01-27T09:13:57.550 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.586 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.043) 0:00:32.609 ***** 2021-01-27T09:13:57.592 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T09:13:57.594 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.632 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.046) 0:00:32.655 ***** 2021-01-27T09:13:57.639 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.680 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.047) 0:00:32.703 ***** 2021-01-27T09:13:57.686 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:13:57.689 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.730 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.049) 0:00:32.752 ***** 2021-01-27T09:13:57.739 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.778 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.048) 0:00:32.801 ***** 2021-01-27T09:13:57.787 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:13:57.788 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.828 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.049) 0:00:32.851 ***** 2021-01-27T09:13:57.838 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.881 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.053) 0:00:32.904 ***** 2021-01-27T09:13:57.889 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:13:57.891 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.947 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.065) 0:00:32.970 ***** 2021-01-27T09:13:57.956 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:57.996 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:57 +0000 (0:00:00.048) 0:00:33.018 ***** 2021-01-27T09:13:58.002 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T09:13:58.004 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.041 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.045) 0:00:33.064 ***** 2021-01-27T09:13:58.050 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.050) 0:00:33.114 ***** 2021-01-27T09:13:58.099 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:13:58.101 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.148 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.055) 0:00:33.170 ***** 2021-01-27T09:13:58.157 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.210 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.062) 0:00:33.232 ***** 2021-01-27T09:13:58.217 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:13:58.219 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.050) 0:00:33.282 ***** 2021-01-27T09:13:58.268 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.324 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.063) 0:00:33.346 ***** 2021-01-27T09:13:58.330 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T09:13:58.332 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.370 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.046) 0:00:33.392 ***** 2021-01-27T09:13:58.377 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.043) 0:00:33.436 ***** 2021-01-27T09:13:58.428 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-27T09:13:58.429 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.470 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.055) 0:00:33.492 ***** 2021-01-27T09:13:58.532 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.044) 0:00:33.537 ***** TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.559 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.044) 0:00:33.581 ***** 2021-01-27T09:13:58.566 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.606 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.047) 0:00:33.629 ***** 2021-01-27T09:13:58.612 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-27T09:13:58.614 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.651 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.044) 0:00:33.673 ***** 2021-01-27T09:13:58.660 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.051) 0:00:33.725 ***** 2021-01-27T09:13:58.709 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-27T09:13:58.711 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.753 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.050) 0:00:33.776 ***** 2021-01-27T09:13:58.763 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.804 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.050) 0:00:33.826 ***** 2021-01-27T09:13:58.810 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-27T09:13:58.812 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.849 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.045) 0:00:33.871 ***** 2021-01-27T09:13:58.855 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.892 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.043) 0:00:33.914 ***** 2021-01-27T09:13:58.898 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-27T09:13:58.900 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.936 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.043) 0:00:33.958 ***** 2021-01-27T09:13:58.942 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:58.987 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:58 +0000 (0:00:00.051) 0:00:34.009 ***** 2021-01-27T09:13:58.994 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-27T09:13:58.996 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:59.037 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.049) 0:00:34.059 ***** 2021-01-27T09:13:59.045 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:59.083 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.046) 0:00:34.106 ***** 2021-01-27T09:13:59.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-27T09:13:59.181 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005413", "end": "2021-01-27 09:13:58.369756", "rc": 0, "start": "2021-01-27 09:13:58.364343", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:59.216 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.132) 0:00:34.238 ***** 2021-01-27T09:13:59.234 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005315", "end": "2021-01-27 09:13:59.640055", "rc": 0, "start": "2021-01-27 09:13:59.634740", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:13:59.271 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.055) 0:00:34.294 ***** 2021-01-27T09:13:59.280 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T09:13:59.315 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.043) 0:00:34.337 ***** 2021-01-27T09:13:59.361 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.046) 0:00:34.383 ***** 2021-01-27T09:13:59.631 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T09:13:59.633 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T09:13:59.668 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.307) 0:00:34.691 ***** 2021-01-27T09:13:59.695 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-27T09:13:59.697 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:59.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.062) 0:00:34.754 ***** 2021-01-27T09:13:59.738 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T09:13:59.740 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T09:13:59.777 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.045) 0:00:34.800 ***** 2021-01-27T09:13:59.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-27T09:13:59.806 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:13:59.841 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:13:59 +0000 (0:00:00.063) 0:00:34.863 ***** 2021-01-27T09:14:00.919 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi103.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T09:14:01.003 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T09:14:01.857 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T09:14:01.895 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:01 +0000 (0:00:02.054) 0:00:36.917 ***** 2021-01-27T09:14:01.997 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T09:14:02.039 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.143) 0:00:37.061 ***** 2021-01-27T09:14:02.552 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T09:14:02.554 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:02.589 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.549) 0:00:37.611 ***** 2021-01-27T09:14:02.617 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T09:14:02.653 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.063) 0:00:37.675 ***** 2021-01-27T09:14:02.726 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T09:14:02.728 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:02.769 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.116) 0:00:37.791 ***** 2021-01-27T09:14:02.797 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T09:14:02.854 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.085) 0:00:37.876 ***** 2021-01-27T09:14:02.865 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-27T09:14:02.867 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032130", "end": "2021-01-27 09:14:03.243976", "rc": 0, "start": "2021-01-27 09:14:03.211846", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:02.917 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:02 +0000 (0:00:00.062) 0:00:37.939 ***** 2021-01-27T09:14:02.918 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:03.041 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035022", "end": "2021-01-27 09:14:02.226685", "rc": 0, "start": "2021-01-27 09:14:02.191663", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:03.077 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:03 +0000 (0:00:00.160) 0:00:38.100 ***** 2021-01-27T09:14:05.105 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-27T09:14:05.107 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:05.144 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:05 +0000 (0:00:02.066) 0:00:40.166 ***** 2021-01-27T09:14:05.362 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:05.399 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:05 +0000 (0:00:00.254) 0:00:40.421 ***** 2021-01-27T09:14:17.026 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-27T09:14:17.028 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T09:14:17.030 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:14:17.065 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:17 +0000 (0:00:11.665) 0:00:52.087 ***** 2021-01-27T09:14:17.481 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T09:14:17.483 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:14:17.518 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:17 +0000 (0:00:00.453) 0:00:52.540 ***** 2021-01-27T09:14:17.691 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:17.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:17 +0000 (0:00:00.213) 0:00:52.754 ***** 2021-01-27T09:14:17.758 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-27T09:14:17.760 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:17.798 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:17 +0000 (0:00:00.066) 0:00:52.820 ***** 2021-01-27T09:14:18.177 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:14:18.179 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:18.217 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:18 +0000 (0:00:00.419) 0:00:53.239 ***** 2021-01-27T09:14:18.255 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-27T09:14:18.257 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:18.298 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:18 +0000 (0:00:00.081) 0:00:53.321 ***** 2021-01-27T09:14:26.978 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:14:26.980 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T09:14:26.982 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T09:14:26.984 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T09:14:26.986 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:14:27.036 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:27 +0000 (0:00:08.737) 0:01:02.059 ***** 2021-01-27T09:14:27.688 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T09:14:27.690 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:27.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:27 +0000 (0:00:00.699) 0:01:02.758 ***** 2021-01-27T09:14:27.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:14:27.841 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T09:14:27.842 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T09:14:27.844 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T09:14:27.846 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:14:27.881 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:27 +0000 (0:00:00.145) 0:01:02.904 ***** 2021-01-27T09:14:27.891 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T09:14:27.892 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T09:14:27.935 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:27 +0000 (0:00:00.054) 0:01:02.958 ***** 2021-01-27T09:14:27.963 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T09:14:27.965 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:27.999 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:27 +0000 (0:00:00.063) 0:01:03.022 ***** 2021-01-27T09:14:28.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-27T09:14:28.144 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T09:14:28.180 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.180) 0:01:03.203 ***** 2021-01-27T09:14:28.528 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T09:14:28.530 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T09:14:28.565 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.385) 0:01:03.588 ***** 2021-01-27T09:14:28.571 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T09:14:28.573 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:28.614 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.048) 0:01:03.637 ***** 2021-01-27T09:14:28.722 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-27T09:14:28.724 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T09:14:28.764 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.149) 0:01:03.786 ***** 2021-01-27T09:14:28.771 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T09:14:28.773 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T09:14:28.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.048) 0:01:03.835 ***** 2021-01-27T09:14:28.840 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T09:14:28.842 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:28.877 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.064) 0:01:03.900 ***** 2021-01-27T09:14:28.906 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T09:14:28.908 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:28.943 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:28 +0000 (0:00:00.066) 0:01:03.966 ***** 2021-01-27T09:14:29.015 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T09:14:29.053 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.109) 0:01:04.075 ***** 2021-01-27T09:14:29.223 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T09:14:29.228 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:13:17 UTC", "ActiveEnterTimestampMonotonic": "17212481", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service basic.target system.slice remote-fs.target systemd-journald.socket -.mount network.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:13:17 UTC", "AssertTimestampMonotonic": "16719626", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:13:17 UTC", "ConditionTimestampMonotonic": "16719625", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T09:14:29.229 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1089", "ExecMainStartTimestamp": "Wed 2021-01-27 09:13:17 UTC", "ExecMainStartTimestampMonotonic": "17212443", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-27T09:14:29.231 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:13:17 UTC", "InactiveExitTimestampMonotonic": "16720760", "InvocationID": "7e396c52c0374215b47a82914f70ead6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1089", "MemoryAccounting": "yes", "MemoryCurrent": "10371072", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-27T09:14:29.232 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:13:17 UTC", "StateChangeTimestampMonotonic": "17212481", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-27T09:14:29.234 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:14:29.274 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.219) 0:01:04.295 ***** 2021-01-27T09:14:29.316 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.353 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.080) 0:01:04.375 ***** 2021-01-27T09:14:29.355 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:29.382 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.067) 0:01:04.443 ***** 2021-01-27T09:14:29.428 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T09:14:29.429 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T09:14:29.469 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.047) 0:01:04.490 ***** 2021-01-27T09:14:29.474 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:14:29.475 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.511 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.043) 0:01:04.533 ***** 2021-01-27T09:14:29.537 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T09:14:29.538 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.578 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.067) 0:01:04.600 ***** 2021-01-27T09:14:29.605 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.649 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.071) 0:01:04.671 ***** 2021-01-27T09:14:29.657 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi047.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T09:14:29.693 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.043) 0:01:04.715 ***** 2021-01-27T09:14:29.701 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:14:29.702 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.742 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.048) 0:01:04.764 ***** 2021-01-27T09:14:29.769 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:14:29.771 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.810 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.068) 0:01:04.832 ***** 2021-01-27T09:14:29.828 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T09:14:29.829 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:29.874 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.064) 0:01:04.896 ***** 2021-01-27T09:14:29.880 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:14:29.882 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.045) 0:01:04.942 ***** 2021-01-27T09:14:29.947 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:29.949 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:29.984 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:29 +0000 (0:00:00.064) 0:01:05.006 ***** 2021-01-27T09:14:30.013 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:14:30.015 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.054 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.070) 0:01:05.077 ***** 2021-01-27T09:14:30.085 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:14:30.087 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.124 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.069) 0:01:05.146 ***** 2021-01-27T09:14:30.152 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T09:14:30.153 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ActiveEnterTimestampMonotonic": "18453391", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target nss-lookup.target network.target -.mount remote-fs.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:12:58 UTC", "AssertTimestampMonotonic": "17855767", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ConditionTimestampMonotonic": "17855766", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T09:14:30.155 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "965", "ExecMainStartTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ExecMainStartTimestampMonotonic": "18453351", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-01-27T09:14:30.156 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:12:58 UTC", "InactiveExitTimestampMonotonic": "17857717", "InvocationID": "7cf75649f94544f6912ebbcd74d845e4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "965", "MemoryAccounting": "yes", "MemoryCurrent": "9457664", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy 2021-01-27T09:14:30.158 INFO:teuthology.task.ansible.out:": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:12:58 UTC", "StateChangeTimestampMonotonic": "18453391", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38341", "TimeoutAbortUSec": " 2021-01-27T09:14:30.160 INFO:teuthology.task.ansible.out:1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.194 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.070) 0:01:05.216 ***** 2021-01-27T09:14:30.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.036) 0:01:05.253 ***** 2021-01-27T09:14:30.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T09:14:30.238 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.278 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.048) 0:01:05.301 ***** 2021-01-27T09:14:30.285 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:14:30.287 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.322 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.043) 0:01:05.344 ***** 2021-01-27T09:14:30.330 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T09:14:30.332 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.370 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.048) 0:01:05.393 ***** 2021-01-27T09:14:30.377 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:14:30.379 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.424 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.053) 0:01:05.447 ***** 2021-01-27T09:14:30.431 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:14:30.433 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.470 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.045) 0:01:05.492 ***** 2021-01-27T09:14:30.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:14:30.479 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.515 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.044) 0:01:05.537 ***** 2021-01-27T09:14:30.521 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T09:14:30.523 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.560 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.045) 0:01:05.582 ***** 2021-01-27T09:14:30.566 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:30.568 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.606 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.045) 0:01:05.628 ***** 2021-01-27T09:14:30.613 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T09:14:30.616 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.658 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.051) 0:01:05.680 ***** 2021-01-27T09:14:30.665 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:14:30.666 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.705 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.047) 0:01:05.727 ***** 2021-01-27T09:14:30.714 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:14:30.716 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.757 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.051) 0:01:05.779 ***** 2021-01-27T09:14:30.763 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T09:14:30.765 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.806 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.049) 0:01:05.829 ***** 2021-01-27T09:14:30.815 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:14:30.816 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.857 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.050) 0:01:05.879 ***** 2021-01-27T09:14:30.863 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:14:30.865 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.906 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.049) 0:01:05.928 ***** 2021-01-27T09:14:30.914 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:14:30.915 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.953 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.047) 0:01:05.976 ***** 2021-01-27T09:14:30.960 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:14:30.961 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:30.999 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:30 +0000 (0:00:00.046) 0:01:06.022 ***** 2021-01-27T09:14:31.006 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:31.007 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.043 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.043) 0:01:06.065 ***** 2021-01-27T09:14:31.049 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:14:31.051 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.090 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.046) 0:01:06.112 ***** 2021-01-27T09:14:31.096 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:14:31.098 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.132 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.042) 0:01:06.155 ***** 2021-01-27T09:14:31.140 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:31.142 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.178 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.045) 0:01:06.200 ***** 2021-01-27T09:14:31.184 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.222 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.044) 0:01:06.245 ***** 2021-01-27T09:14:31.229 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:14:31.231 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.270 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.047) 0:01:06.292 ***** 2021-01-27T09:14:31.275 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:14:31.277 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.042) 0:01:06.335 ***** 2021-01-27T09:14:31.319 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:14:31.321 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.356 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.043) 0:01:06.378 ***** 2021-01-27T09:14:31.362 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:14:31.364 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.401 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.044) 0:01:06.423 ***** 2021-01-27T09:14:31.408 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:31.409 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.447 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.046) 0:01:06.470 ***** 2021-01-27T09:14:31.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:14:31.457 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.494 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.046) 0:01:06.517 ***** 2021-01-27T09:14:31.502 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T09:14:31.504 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.541 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.046) 0:01:06.564 ***** 2021-01-27T09:14:31.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.590 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.048) 0:01:06.612 ***** 2021-01-27T09:14:31.612 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:31.613 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.653 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.062) 0:01:06.675 ***** 2021-01-27T09:14:31.680 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:14:31.682 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T09:14:31.720 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.067) 0:01:06.742 ***** 2021-01-27T09:14:31.762 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.041) 0:01:06.784 ***** 2021-01-27T09:14:31.768 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T09:14:31.770 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.812 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.050) 0:01:06.835 ***** 2021-01-27T09:14:31.839 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:14:31.841 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.876 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.063) 0:01:06.898 ***** 2021-01-27T09:14:31.903 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:31.939 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:31 +0000 (0:00:00.063) 0:01:06.962 ***** 2021-01-27T09:14:31.967 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:14:31.969 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.064) 0:01:07.026 ***** 2021-01-27T09:14:32.031 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:32.033 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.072 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.068) 0:01:07.094 ***** 2021-01-27T09:14:32.090 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:14:32.092 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T09:14:32.129 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.056) 0:01:07.151 ***** 2021-01-27T09:14:32.136 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:14:32.138 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.046) 0:01:07.198 ***** 2021-01-27T09:14:32.183 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.221 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.044) 0:01:07.243 ***** 2021-01-27T09:14:32.227 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:14:32.229 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.265 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.044) 0:01:07.287 ***** 2021-01-27T09:14:32.294 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:14:32.297 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.331 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.065) 0:01:07.353 ***** 2021-01-27T09:14:32.358 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T09:14:32.360 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:32.398 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.066) 0:01:07.420 ***** 2021-01-27T09:14:32.532 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T09:14:32.534 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T09:14:32.571 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.174) 0:01:07.594 ***** 2021-01-27T09:14:32.578 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T09:14:32.580 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T09:14:32.622 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.050) 0:01:07.644 ***** 2021-01-27T09:14:32.902 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:14:32.904 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T09:14:32.941 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.319) 0:01:07.963 ***** 2021-01-27T09:14:32.949 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-27T09:14:32.951 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T09:14:32.989 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:32 +0000 (0:00:00.047) 0:01:08.011 ***** 2021-01-27T09:14:32.996 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.041 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.051) 0:01:08.063 ***** 2021-01-27T09:14:33.331 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T09:14:33.333 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T09:14:33.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.328) 0:01:08.392 ***** 2021-01-27T09:14:33.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T09:14:33.389 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T09:14:33.428 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.058) 0:01:08.450 ***** 2021-01-27T09:14:33.499 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T09:14:33.501 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:33.537 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.108) 0:01:08.559 ***** 2021-01-27T09:14:33.564 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T09:14:33.565 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.603 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.066) 0:01:08.626 ***** 2021-01-27T09:14:33.631 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T09:14:33.633 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.675 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.072) 0:01:08.698 ***** 2021-01-27T09:14:33.703 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T09:14:33.705 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.740 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.064) 0:01:08.762 ***** 2021-01-27T09:14:33.746 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-27T09:14:33.748 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T09:14:33.789 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.048) 0:01:08.811 ***** 2021-01-27T09:14:33.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.839 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.050) 0:01:08.862 ***** 2021-01-27T09:14:33.882 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:33.924 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.084) 0:01:08.946 ***** 2021-01-27T09:14:33.961 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:33.963 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T09:14:33.998 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:33 +0000 (0:00:00.073) 0:01:09.020 ***** 2021-01-27T09:14:34.048 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T09:14:34.050 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.052 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.068 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.079 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.090 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.101 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.112 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T09:14:34.123 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.133 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.135 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T09:14:34.175 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.177) 0:01:09.197 ***** 2021-01-27T09:14:34.182 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T09:14:34.183 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.184 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.195 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.237 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.062) 0:01:09.260 ***** 2021-01-27T09:14:34.322 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T09:14:34.324 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:34.362 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.125) 0:01:09.385 ***** 2021-01-27T09:14:34.392 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T09:14:34.394 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.430 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.067) 0:01:09.452 ***** 2021-01-27T09:14:34.448 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T09:14:34.450 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006505", "end": "2021-01-27 09:14:34.418513", "rc": 0, "start": "2021-01-27 09:14:34.412008", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T09:14:34.494 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.063) 0:01:09.516 ***** 2021-01-27T09:14:34.500 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.541 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.047) 0:01:09.564 ***** 2021-01-27T09:14:34.550 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T09:14:34.551 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.590 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.048) 0:01:09.612 ***** 2021-01-27T09:14:34.595 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T09:14:34.597 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.635 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.045) 0:01:09.657 ***** 2021-01-27T09:14:34.646 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.689 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.053) 0:01:09.711 ***** 2021-01-27T09:14:34.695 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-27T09:14:34.697 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.732 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.043) 0:01:09.755 ***** 2021-01-27T09:14:34.741 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.782 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.049) 0:01:09.804 ***** 2021-01-27T09:14:34.788 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T09:14:34.790 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.044) 0:01:09.849 ***** 2021-01-27T09:14:34.864 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:34.866 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T09:14:34.902 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:34 +0000 (0:00:00.075) 0:01:09.924 ***** 2021-01-27T09:14:34.950 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T09:14:34.951 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.961 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.963 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.973 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.984 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:34.995 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.006 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T09:14:35.008 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.028 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.030 INFO:teuthology.task.ansible.out: skipping: [smithi047.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.041 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.052 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.063 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.065 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.107 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.205) 0:01:10.130 ***** 2021-01-27T09:14:35.302 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T09:14:35.304 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003183", "end": "2021-01-27 09:14:35.279829", "rc": 0, "start": "2021-01-27 09:14:35.276646", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T09:14:35.343 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.235) 0:01:10.365 ***** 2021-01-27T09:14:35.370 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T09:14:35.372 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.411 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.067) 0:01:10.433 ***** 2021-01-27T09:14:35.440 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T09:14:35.441 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.478 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.067) 0:01:10.501 ***** 2021-01-27T09:14:35.511 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.033) 0:01:10.534 ***** 2021-01-27T09:14:35.517 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T09:14:35.519 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.559 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.047) 0:01:10.581 ***** 2021-01-27T09:14:35.566 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T09:14:35.568 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.613 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.053) 0:01:10.635 ***** 2021-01-27T09:14:35.654 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:14:35.656 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={'block_used': 13965176, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129932, 'size_available': 926228201472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129932, "block_size": 4096, "block_total": 240095108, "block_used": 13965176, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228201472, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T09:14:35.693 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.080) 0:01:10.715 ***** 2021-01-27T09:14:35.834 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T09:14:35.835 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009094", "end": "2021-01-27 09:14:36.245514", "rc": 0, "start": "2021-01-27 09:14:36.236420", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:35.874 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.180) 0:01:10.896 ***** 2021-01-27T09:14:35.924 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T09:14:35.925 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'block_used': 13965176, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129932, 'size_available': 926228201472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129932, "block_size": 4096, "block_total": 240095108, "block_used": 13965176, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228201472, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:35.964 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:35 +0000 (0:00:00.090) 0:01:10.987 ***** 2021-01-27T09:14:35.991 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T09:14:36.028 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.063) 0:01:11.050 ***** 2021-01-27T09:14:36.075 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:14:36.077 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:36.213 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T09:14:36.214 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:36.251 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.223) 0:01:11.273 ***** 2021-01-27T09:14:36.278 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T09:14:36.280 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:36.320 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.069) 0:01:11.343 ***** 2021-01-27T09:14:36.359 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:14:36.361 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item={'block_used': 13965189, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129919, 'size_available': 926228148224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129919, "block_size": 4096, "block_total": 240095108, "block_used": 13965189, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228148224, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T09:14:36.396 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.075) 0:01:11.419 ***** 2021-01-27T09:14:36.542 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009473", "end": "2021-01-27 09:14:35.733199", "rc": 0, "start": "2021-01-27 09:14:35.723726", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:36.586 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.189) 0:01:11.608 ***** 2021-01-27T09:14:36.624 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T09:14:36.626 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'block_used': 13965189, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129919, 'size_available': 926228148224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129919, "block_size": 4096, "block_total": 240095108, "block_used": 13965189, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228148224, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:36.662 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.075) 0:01:11.684 ***** 2021-01-27T09:14:36.688 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T09:14:36.725 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:36 +0000 (0:00:00.062) 0:01:11.747 ***** 2021-01-27T09:14:36.783 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:14:36.785 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:37.843 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnW51frLmymymcsuD9SmRKSK65phwVdQe3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.643159", "end": "2021-01-27 09:14:38.246534", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnW51frLmymymcsuD9SmRKSK65phwVdQe3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:36.603375", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:37.854 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:37.866 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:38.410 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce80cPA2LDgd32sZ4RVuKo7oVWFq56qNfF'], 'uuids': ['1b45dafa-f4b6-408a-a5ca-f440e954f400']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.504536", "end": "2021-01-27 09:14:37.591799", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce80cPA2LDgd32sZ4RVuKo7oVWFq56qNfF"], "labels": [], "masters": [], "uuids": ["1b45dafa-f4b6-408a-a5ca-f440e954f400"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:36.087263", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:38.421 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:38.433 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:39.127 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPn2FDU8T2feKEWBnr9CWH4h9G63QjKiUub'], 'uuids': ['ed908e87-efdb-4167-bd45-1ab09659581a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.133955", "end": "2021-01-27 09:14:39.524945", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPn2FDU8T2feKEWBnr9CWH4h9G63QjKiUub"], "labels": [], "masters": [], "uuids": ["ed908e87-efdb-4167-bd45-1ab09659581a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:38.390990", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:39.129 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QBMV', 'wwn-0x5000c50091e0b337'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1', 'wwn-0x5000c50091e0b337-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0b337', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QBMV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV", "wwn-0x5000c50091e0b337"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1", "wwn-0x5000c50091e0b337-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QBMV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b337"}}, 2021-01-27T09:14:39.130 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:14:39.736 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ceVoqoxDhbe7EFbEmU2JpPNYboKbkKA73R'], 'uuids': ['36a530a2-ff94-4682-9ef2-181aacf8f1de']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.166842", "end": "2021-01-27 09:14:38.914755", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ceVoqoxDhbe7EFbEmU2JpPNYboKbkKA73R"], "labels": [], "masters": [], "uuids": ["36a530a2-ff94-4682-9ef2-181aacf8f1de"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:37.747913", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:39.737 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:39.739 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HN80', 'wwn-0x5000c500871ae812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HN80-part1', 'wwn-0x5000c500871ae812-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871ae812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HN80', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HN80", "wwn-0x5000c500871ae812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HN80-part1", "wwn-0x5000c500871ae812-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HN80", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ae812"}}, 2021-01-27T09:14:39.741 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:14:40.453 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-fnquvF-o4qD-u2PM-U14g-Xdd6-2ls6-31ZdEG', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN', 'nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.189011", "end": "2021-01-27 09:14:40.849040", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fnquvF-o4qD-u2PM-U14g-Xdd6-2ls6-31ZdEG", "nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN", "nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:39.660029", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T09:14:40.455 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:40.465 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:40.477 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:41.044 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kdvaT2-NZN6-NjBt-8ZVt-zKen-qYpd-rP1PzR', 'nvme-INTEL_SSDPED1D480GA_PHMB75130022480DGN', 'nvme-nvme.8086-50484d42373531333030323234383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.168963", "end": "2021-01-27 09:14:40.220215", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-kdvaT2-NZN6-NjBt-8ZVt-zKen-qYpd-rP1PzR", "nvme-INTEL_SSDPED1D480GA_PHMB75130022480DGN", "nvme-nvme.8086-50484d42373531333030323234383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:39.051252", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You 2021-01-27T09:14:41.046 INFO:teuthology.task.ansible.out:may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:41.056 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:41.768 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnKAjCg4tc7capwFRlCR0AyGaDUPDPoNBx'], 'uuids': ['928d2c86-5684-4732-ba8c-11d323088e88']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.156779", "end": "2021-01-27 09:14:42.169224", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnKAjCg4tc7capwFRlCR0AyGaDUPDPoNBx"], "labels": [], "masters": [], "uuids": ["928d2c86-5684-4732-ba8c-11d323088e88"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:41.012445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:41.778 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:41.790 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:42.355 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce6NVQpw7a5MDCBy61yQstViNCFyb1oRS6'], 'uuids': ['01c41aea-a11e-4fbb-bc53-8f1bd9215ab2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.170458", "end": "2021-01-27 09:14:41.532293", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce6NVQpw7a5MDCBy61yQstViNCFyb1oRS6"], "labels": [], "masters": [], "uuids": ["01c41aea-a11e-4fbb-bc53-8f1bd9215ab2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:40.361835", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:42.367 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:42.368 INFO:teuthology.task.ansible.out: skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:43.062 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnmUgOeRf26OYEwh1z2AeiOaNVlemrjs6e'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.142604", "end": "2021-01-27 09:14:43.460741", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnmUgOeRf26OYEwh1z2AeiOaNVlemrjs6e"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:42.318137", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:43.073 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:43.650 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9cexpo9LEkGCgZpuWuj1FkjF1BkAsz12CvF'], 'uuids': ['49913187-429a-4c7e-a3bf-aa811b8bb3eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.150964", "end": "2021-01-27 09:14:42.831446", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9cexpo9LEkGCgZpuWuj1FkjF1BkAsz12CvF"], "labels": [], "masters": [], "uuids": ["49913187-429a-4c7e-a3bf-aa811b8bb3eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:41.680482", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:43.661 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:44.340 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnuEYbDyJJ6B9DlAYzKqyuOPOWO01Z3lL1'], 'uuids': ['be9c9917-6505-4363-954f-e347981b92a9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.134842", "end": "2021-01-27 09:14:44.743321", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnuEYbDyJJ6B9DlAYzKqyuOPOWO01Z3lL1"], "labels": [], "masters": [], "uuids": ["be9c9917-6505-4363-954f-e347981b92a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:43.608479", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:44.388 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:44 +0000 (0:00:07.663) 0:01:19.410 ***** 2021-01-27T09:14:44.446 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:14:44.448 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:44.739 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnW51frLmymymcsuD9SmRKSK65phwVdQe3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.167238", "end": "2021-01-27 09:14:45.145895", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnW51frLmymymcsuD9SmRKSK65phwVdQe3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:44.978657", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162285 s, 711 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162285 s, 711 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:44.753 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:44.766 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:44.955 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:14:44.957 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9celB0I6mdwRgIN9JE7fd9MBMrOCqfq2DGr'], 'uuids': ['6112e52d-f17d-4605-b1e1-ec9cd6f9d805']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.160128", "end": "2021-01-27 09:14:44.129622", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9celB0I6mdwRgIN9JE7fd9MBMrOCqfq2DGr"], "labels": [], "masters": [], "uuids": ["6112e52d-f17d-4605-b1e1-ec9cd6f9d805"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:42.969494", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:14:45.002 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:44 +0000 (0:00:00.613) 0:01:20.024 ***** 2021-01-27T09:14:45.050 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:14:45.052 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPn2FDU8T2feKEWBnr9CWH4h9G63QjKiUub'], 'uuids': ['ed908e87-efdb-4167-bd45-1ab09659581a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167824", "end": "2021-01-27 09:14:45.455233", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPn2FDU8T2feKEWBnr9CWH4h9G63QjKiUub"], "labels": [], "masters": [], "uuids": ["ed908e87-efdb-4167-bd45-1ab09659581a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", 2021-01-27T09:14:45.053 INFO:teuthology.task.ansible.out: "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.287409", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162944 s, 708 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162944 s, 708 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.066 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QBMV', 'wwn-0x5000c50091e0b337'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1', 'wwn-0x5000c50091e0b337-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0b337', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QBMV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV", "wwn-0x5000c50091e0b337"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1", "wwn-0x5000c50091e0b337-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QBMV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b337"}}, 2021-01-27T09:14:45.068 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.236 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-fnquvF-o4qD-u2PM-U14g-Xdd6-2ls6-31ZdEG', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN', 'nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056648", "end": "2021-01-27 09:14:45.645854", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fnquvF-o4qD-u2PM-U14g-Xdd6-2ls6-31ZdEG", "nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN", "nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.589206", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0519128 s, 2.2 GB/s", "std 2021-01-27T09:14:45.238 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0519128 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.248 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.259 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.292 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce80cPA2LDgd32sZ4RVuKo7oVWFq56qNfF'], 'uuids': ['1b45dafa-f4b6-408a-a5ca-f440e954f400']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.117724", "end": "2021-01-27 09:14:44.473734", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce80cPA2LDgd32sZ4RVuKo7oVWFq56qNfF"], "labels": [], "masters": [], "uuids": ["1b45dafa-f4b6-408a-a5ca-f440e954f400"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:44.356010", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.112997 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.112997 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.304 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.539 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnKAjCg4tc7capwFRlCR0AyGaDUPDPoNBx'], 'uuids': ['928d2c86-5684-4732-ba8c-11d323088e88']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157307", "end": "2021-01-27 09:14:45.948654", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnKAjCg4tc7capwFRlCR0AyGaDUPDPoNBx"], "labels": [], "masters": [], "uuids": ["928d2c86-5684-4732-ba8c-11d323088e88"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.791347", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154217 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154217 s, 748 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.551 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.564 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ceVoqoxDhbe7EFbEmU2JpPNYboKbkKA73R'], 'uuids': ['36a530a2-ff94-4682-9ef2-181aacf8f1de']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.116580", "end": "2021-01-27 09:14:44.742929", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ceVoqoxDhbe7EFbEmU2JpPNYboKbkKA73R"], "labels": [], "masters": [], "uuids": ["36a530a2-ff94-4682-9ef2-181aacf8f1de"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:44.626349", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111862 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111862 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.566 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.569 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HN80', 'wwn-0x5000c500871ae812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HN80-part1', 'wwn-0x5000c500871ae812-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871ae812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HN80', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HN80", "wwn-0x5000c500871ae812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HN80-part1", "wwn-0x5000c500871ae812-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HN80", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ae812"}}, 2021-01-27T09:14:45.570 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.750 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kdvaT2-NZN6-NjBt-8ZVt-zKen-qYpd-rP1PzR', 'nvme-INTEL_SSDPED1D480GA_PHMB75130022480DGN', 'nvme-nvme.8086-50484d42373531333030323234383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055606", "end": "2021-01-27 09:14:44.933118", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-kdvaT2-NZN6-NjBt-8ZVt-zKen-qYpd-rP1PzR", "nvme-INTEL_SSDPED1D480GA_PHMB75130022480DGN", "nvme-nvme.8086-50484d42373531333030323234383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:44.877512", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0509073 s, 2.3 GB/s", "stderr_lines": [" 2021-01-27T09:14:45.752 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0509073 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.762 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.763 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:45.860 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnmUgOeRf26OYEwh1z2AeiOaNVlemrjs6e'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.164139", "end": "2021-01-27 09:14:46.261853", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnmUgOeRf26OYEwh1z2AeiOaNVlemrjs6e"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:46.097714", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159293 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159293 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:45.873 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:46.001 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce6NVQpw7a5MDCBy61yQstViNCFyb1oRS6'], 'uuids': ['01c41aea-a11e-4fbb-bc53-8f1bd9215ab2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.113822", "end": "2021-01-27 09:14:45.183864", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9ce6NVQpw7a5MDCBy61yQstViNCFyb1oRS6"], "labels": [], "masters": [], "uuids": ["01c41aea-a11e-4fbb-bc53-8f1bd9215ab2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.070042", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109258 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109258 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.014 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:46.025 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:46.163 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnuEYbDyJJ6B9DlAYzKqyuOPOWO01Z3lL1'], 'uuids': ['be9c9917-6505-4363-954f-e347981b92a9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162560", "end": "2021-01-27 09:14:46.559141", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-UmfFvkmfm0YWUEvq0a0o5uMKtmjf8jPnuEYbDyJJ6B9DlAYzKqyuOPOWO01Z3lL1"], "labels": [], "masters": [], "uuids": ["be9c9917-6505-4363-954f-e347981b92a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:46.396581", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157747 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157747 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.210 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:01.208) 0:01:21.232 ***** 2021-01-27T09:14:46.248 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9cexpo9LEkGCgZpuWuj1FkjF1BkAsz12CvF'], 'uuids': ['49913187-429a-4c7e-a3bf-aa811b8bb3eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.115251", "end": "2021-01-27 09:14:45.437484", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9cexpo9LEkGCgZpuWuj1FkjF1BkAsz12CvF"], "labels": [], "masters": [], "uuids": ["49913187-429a-4c7e-a3bf-aa811b8bb3eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.322233", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110422 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110422 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.260 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:46.493 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9celB0I6mdwRgIN9JE7fd9MBMrOCqfq2DGr'], 'uuids': ['6112e52d-f17d-4605-b1e1-ec9cd6f9d805']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.113994", "end": "2021-01-27 09:14:45.675402", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Z0F5KGZQV1IcSrPnN6dyb0xi6OyUw9celB0I6mdwRgIN9JE7fd9MBMrOCqfq2DGr"], "labels": [], "masters": [], "uuids": ["6112e52d-f17d-4605-b1e1-ec9cd6f9d805"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:14:45.561408", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110486 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110486 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.543 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:00.332) 0:01:21.565 ***** 2021-01-27T09:14:46.551 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T09:14:46.553 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.181523", "end": "2021-01-27 09:14:46.937162", "rc": 0, "start": "2021-01-27 09:14:46.755639", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.593 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:00.050) 0:01:21.615 ***** 2021-01-27T09:14:46.811 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T09:14:46.813 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.078054", "end": "2021-01-27 09:14:47.217837", "rc": 0, "start": "2021-01-27 09:14:47.139783", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.848 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:00.254) 0:01:21.870 ***** 2021-01-27T09:14:46.853 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T09:14:46.855 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.146647", "end": "2021-01-27 09:14:46.008514", "rc": 0, "start": "2021-01-27 09:14:45.861867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:46.891 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:00.043) 0:01:21.913 ***** 2021-01-27T09:14:46.899 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T09:14:46.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:46 +0000 (0:00:00.048) 0:01:21.962 ***** 2021-01-27T09:14:46.968 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.012 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.072) 0:01:22.034 ***** 2021-01-27T09:14:47.042 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T09:14:47.043 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.082 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.069) 0:01:22.104 ***** 2021-01-27T09:14:47.108 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:14:47.110 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.145 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.063) 0:01:22.168 ***** 2021-01-27T09:14:47.151 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T09:14:47.153 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.085439", "end": "2021-01-27 09:14:46.309160", "rc": 0, "start": "2021-01-27 09:14:46.223721", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:14:47.190 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.044) 0:01:22.213 ***** 2021-01-27T09:14:47.197 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T09:14:47.198 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.234 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.043) 0:01:22.257 ***** 2021-01-27T09:14:47.240 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T09:14:47.281 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.046) 0:01:22.303 ***** 2021-01-27T09:14:47.308 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-27T09:14:47.310 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.351 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.069) 0:01:22.373 ***** 2021-01-27T09:14:47.368 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T09:14:47.370 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:47.412 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.061) 0:01:22.434 ***** 2021-01-27T09:14:47.420 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T09:14:47.422 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.465 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.053) 0:01:22.488 ***** 2021-01-27T09:14:47.476 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:14:47.478 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'block_used': 13965176, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129932, 'size_available': 926228201472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129932, "block_size": 4096, "block_total": 240095108, "block_used": 13965176, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228201472, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.516 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.050) 0:01:22.539 ***** 2021-01-27T09:14:47.523 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:14:47.524 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.576 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.059) 0:01:22.599 ***** 2021-01-27T09:14:47.584 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-27T09:14:47.586 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.624 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.047) 0:01:22.646 ***** 2021-01-27T09:14:47.631 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:47.633 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.673 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.048) 0:01:22.695 ***** 2021-01-27T09:14:47.679 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:47.681 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.725 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.051) 0:01:22.747 ***** 2021-01-27T09:14:47.751 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:47.753 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.790 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.064) 0:01:22.811 ***** 2021-01-27T09:14:47.795 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T09:14:47.796 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:14:47.832 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.043) 0:01:22.855 ***** 2021-01-27T09:14:47.838 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T09:14:47.840 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.876 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.044) 0:01:22.899 ***** 2021-01-27T09:14:47.882 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:14:47.884 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'block_used': 13965189, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129919, 'size_available': 926228148224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129919, "block_size": 4096, "block_total": 240095108, "block_used": 13965189, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228148224, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.922 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.046) 0:01:22.945 ***** 2021-01-27T09:14:47.929 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-27T09:14:47.930 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:47.972 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:47 +0000 (0:00:00.049) 0:01:22.994 ***** 2021-01-27T09:14:47.978 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-27T09:14:47.980 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.018 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.045) 0:01:23.040 ***** 2021-01-27T09:14:48.026 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T09:14:48.027 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.028 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:48.064 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.046) 0:01:23.086 ***** 2021-01-27T09:14:48.071 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:48.072 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.110 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.045) 0:01:23.132 ***** 2021-01-27T09:14:48.149 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:48.151 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.189 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.079) 0:01:23.211 ***** 2021-01-27T09:14:48.190 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:48.227 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T09:14:48.229 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.265 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.076) 0:01:23.287 ***** 2021-01-27T09:14:48.302 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-27T09:14:48.304 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.342 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.077) 0:01:23.365 ***** 2021-01-27T09:14:48.372 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T09:14:48.374 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:48.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.071) 0:01:23.436 ***** 2021-01-27T09:14:48.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-27T09:14:48.890 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T09:14:48.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.511) 0:01:23.948 ***** 2021-01-27T09:14:48.954 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T09:14:48.992 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:48 +0000 (0:00:00.066) 0:01:24.015 ***** 2021-01-27T09:14:49.644 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:49.645 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.012 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.023 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.389 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.411 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.779 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:50.790 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:51.173 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:51.177 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:14:51.215 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:02.222) 0:01:26.238 ***** 2021-01-27T09:14:51.250 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:00.034) 0:01:26.273 ***** 2021-01-27T09:14:51.342 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:14:51.344 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T09:14:51.383 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:00.132) 0:01:26.405 ***** 2021-01-27T09:14:51.390 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T09:14:51.432 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:00.048) 0:01:26.454 ***** 2021-01-27T09:14:51.525 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-27T09:14:51.527 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.591 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.656 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.710 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.775 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.820 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.885 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.896 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:51.937 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:00.504) 0:01:26.959 ***** 2021-01-27T09:14:51.945 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:14:51.957 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:51.996 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:51 +0000 (0:00:00.059) 0:01:27.019 ***** 2021-01-27T09:14:52.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-27T09:14:52.004 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:52.043 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.046) 0:01:27.065 ***** 2021-01-27T09:14:52.050 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:52.086 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.043) 0:01:27.109 ***** 2021-01-27T09:14:52.093 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-27T09:14:52.094 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:52.131 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.044) 0:01:27.153 ***** 2021-01-27T09:14:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:52.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.045) 0:01:27.198 ***** 2021-01-27T09:14:52.265 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T09:14:52.267 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:14:52.306 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.130) 0:01:27.328 ***** 2021-01-27T09:14:52.314 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:14:52.354 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.047) 0:01:27.376 ***** 2021-01-27T09:14:52.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T09:14:52.363 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T09:14:52.402 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.048) 0:01:27.425 ***** 2021-01-27T09:14:52.409 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T09:14:52.451 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.048) 0:01:27.474 ***** 2021-01-27T09:14:52.839 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-27T09:14:52.840 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true} 2021-01-27T09:14:52.880 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.428) 0:01:27.902 ***** 2021-01-27T09:14:52.882 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:52.909 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true} 2021-01-27T09:14:52.946 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:52 +0000 (0:00:00.066) 0:01:27.969 ***** 2021-01-27T09:14:53.341 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-27T09:14:53.343 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T09:14:53.382 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.435) 0:01:28.404 ***** 2021-01-27T09:14:53.384 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:53.390 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T09:14:53.427 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.045) 0:01:28.450 ***** 2021-01-27T09:14:53.433 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-27T09:14:53.436 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.472 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.045) 0:01:28.495 ***** 2021-01-27T09:14:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.519 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.047) 0:01:28.542 ***** 2021-01-27T09:14:53.525 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-27T09:14:53.527 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.043) 0:01:28.585 ***** 2021-01-27T09:14:53.570 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.606 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.042) 0:01:28.628 ***** 2021-01-27T09:14:53.618 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T09:14:53.621 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.662 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.056) 0:01:28.684 ***** 2021-01-27T09:14:53.669 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.716 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.053) 0:01:28.738 ***** 2021-01-27T09:14:53.721 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T09:14:53.723 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.760 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.044) 0:01:28.782 ***** 2021-01-27T09:14:53.768 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:53.806 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.046) 0:01:28.828 ***** 2021-01-27T09:14:53.907 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-27T09:14:53.909 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:14:53.945 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:53 +0000 (0:00:00.139) 0:01:28.968 ***** 2021-01-27T09:14:53.967 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:14:54.023 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.077) 0:01:29.045 ***** 2021-01-27T09:14:54.095 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-27T09:14:54.096 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:14:54.131 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.108) 0:01:29.154 ***** 2021-01-27T09:14:54.170 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:14:54.210 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.078) 0:01:29.232 ***** 2021-01-27T09:14:54.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-27T09:14:54.480 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T09:14:54.515 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.305) 0:01:29.537 ***** 2021-01-27T09:14:54.554 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T09:14:54.594 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.079) 0:01:29.617 ***** 2021-01-27T09:14:54.899 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-27T09:14:54.901 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T09:14:54.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:54 +0000 (0:00:00.346) 0:01:29.963 ***** 2021-01-27T09:14:54.970 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T09:14:55.010 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:55 +0000 (0:00:00.069) 0:01:30.032 ***** 2021-01-27T09:14:55.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-27T09:14:55.664 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:55.700 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:55 +0000 (0:00:00.689) 0:01:30.722 ***** 2021-01-27T09:14:55.735 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:55 +0000 (0:00:00.035) 0:01:30.757 ***** 2021-01-27T09:14:55.966 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T09:14:55.968 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.118516", "end": "2021-01-27 09:14:55.148094", "rc": 0, "start": "2021-01-27 09:14:55.029578", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T09:14:56.024 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.289) 0:01:31.047 ***** 2021-01-27T09:14:56.032 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.111621", "end": "2021-01-27 09:14:56.406120", "rc": 0, "start": "2021-01-27 09:14:56.294499", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T09:14:56.071 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.046) 0:01:31.093 ***** 2021-01-27T09:14:56.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:56.118 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.047) 0:01:31.141 ***** 2021-01-27T09:14:56.126 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:56.166 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.047) 0:01:31.188 ***** 2021-01-27T09:14:56.172 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-27T09:14:56.175 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:56.211 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.044) 0:01:31.233 ***** 2021-01-27T09:14:56.217 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:56.256 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.044) 0:01:31.278 ***** 2021-01-27T09:14:56.865 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T09:14:56.866 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:56.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.645) 0:01:31.924 ***** 2021-01-27T09:14:56.908 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:56.945 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.043) 0:01:31.968 ***** 2021-01-27T09:14:56.951 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T09:14:56.953 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:56.994 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:56 +0000 (0:00:00.048) 0:01:32.016 ***** 2021-01-27T09:14:57.002 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:57.040 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.045) 0:01:32.062 ***** 2021-01-27T09:14:57.319 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:57.320 INFO:teuthology.task.ansible.out:TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T09:14:57.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.317) 0:01:32.380 ***** 2021-01-27T09:14:57.369 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T09:14:57.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.047) 0:01:32.428 ***** 2021-01-27T09:14:57.413 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:57.456 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.049) 0:01:32.478 ***** 2021-01-27T09:14:57.464 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:57.503 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.046) 0:01:32.525 ***** 2021-01-27T09:14:57.671 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T09:14:57.673 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ActiveEnterTimestampMonotonic": "18055772", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target systemd-tmpfiles-setup.service network.target system.slice systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:12:58 UTC", "AssertTimestampMonotonic": "17807626", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ConditionTimestampMonotonic": "17807622", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-27T09:14:57.674 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "905", "ExecMainStartTimestamp": "Wed 2021-01-27 09:12:58 UTC", "ExecMainStartTimestampMonotonic": "18055741", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:12:58 UTC", "InactiveExitTimestampMonotonic": "17809988", "InvocationID": "ffe837bacb8e475f9920b26235631234", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T09:14:57.676 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "905", "MemoryAccounting": "yes", "MemoryCurrent": "3829760", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-01-27T09:14:57.677 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:12:58 UTC", "StateChangeTimestampMonotonic": "18055772", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38341", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:14:57.715 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.212) 0:01:32.737 ***** 2021-01-27T09:14:57.725 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:13:15 UTC", "ActiveEnterTimestampMonotonic": "14739748", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount system.slice network.target systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:13:14 UTC", "AssertTimestampMonotonic": "14435421", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:13:14 UTC", "ConditionTimestampMonotonic": "14435418", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-27T09:14:57.732 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "882", "ExecMainStartTimestamp": "Wed 2021-01-27 09:13:15 UTC", "ExecMainStartTimestampMonotonic": "14739734", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:13:14 UTC", "InactiveExitTimestampMonotonic": "14436669", "InvocationID": "b0e7c6a92aca4dfbadc7f623d78fe9b4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T09:14:57.734 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "882", "MemoryAccounting": "yes", "MemoryCurrent": "3534848", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-01-27T09:14:57.736 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:13:15 UTC", "StateChangeTimestampMonotonic": "14739748", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:14:57.771 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.056) 0:01:32.794 ***** 2021-01-27T09:14:57.773 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:57.780 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:57.782 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T09:14:57.819 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.047) 0:01:32.841 ***** 2021-01-27T09:14:57.833 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T09:14:57.874 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.054) 0:01:32.896 ***** 2021-01-27T09:14:57.881 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:14:57.883 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T09:14:57.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.066) 0:01:32.962 ***** 2021-01-27T09:14:57.947 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T09:14:57.983 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:57 +0000 (0:00:00.043) 0:01:33.006 ***** 2021-01-27T09:14:57.989 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T09:14:57.991 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:58.027 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:58 +0000 (0:00:00.043) 0:01:33.049 ***** 2021-01-27T09:14:58.034 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:58.071 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:58 +0000 (0:00:00.044) 0:01:33.094 ***** 2021-01-27T09:14:59.300 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-27T09:14:59.302 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:14:59.340 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:01.268) 0:01:34.362 ***** 2021-01-27T09:14:59.347 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:14:59.386 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:00.046) 0:01:34.408 ***** 2021-01-27T09:14:59.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T09:14:59.393 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:59.429 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:00.043) 0:01:34.452 ***** 2021-01-27T09:14:59.436 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:14:59.481 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:00.050) 0:01:34.502 ***** 2021-01-27T09:14:59.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-27T09:14:59.613 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:14:59.657 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:00.177) 0:01:34.679 ***** 2021-01-27T09:14:59.676 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:14:59.678 INFO:teuthology.task.ansible.out: 2021-01-27T09:14:59.717 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:14:59 +0000 (0:00:00.059) 0:01:34.739 ***** 2021-01-27T09:15:00.145 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:00.147 INFO:teuthology.task.ansible.out:TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T09:15:00.184 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:00 +0000 (0:00:00.467) 0:01:35.206 ***** 2021-01-27T09:15:00.192 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T09:15:00.231 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:00 +0000 (0:00:00.047) 0:01:35.254 ***** 2021-01-27T09:15:02.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-27T09:15:02.986 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T09:15:03.046 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:02.815) 0:01:38.069 ***** 2021-01-27T09:15:03.200 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T09:15:03.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.213) 0:01:38.282 ***** 2021-01-27T09:15:03.551 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T09:15:03.554 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false} 2021-01-27T09:15:03.592 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.332) 0:01:38.614 ***** 2021-01-27T09:15:03.630 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-27T09:15:03.632 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T09:15:03.669 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.077) 0:01:38.692 ***** 2021-01-27T09:15:03.794 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T09:15:03.796 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false} 2021-01-27T09:15:03.834 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.164) 0:01:38.857 ***** 2021-01-27T09:15:03.852 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T09:15:03.854 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611738542.4205434, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611738541.1085434, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611738541.1085434, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T09:15:03.894 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.059) 0:01:38.917 ***** 2021-01-27T09:15:03.905 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-01-27T09:15:03.947 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:03 +0000 (0:00:00.052) 0:01:38.969 ***** 2021-01-27T09:15:04.164 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T09:15:04.166 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611738473.247463, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611738473.243463, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611738473.243463, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T09:15:04.202 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.255) 0:01:39.225 ***** 2021-01-27T09:15:04.347 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-27T09:15:04.349 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T09:15:04.387 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.184) 0:01:39.410 ***** 2021-01-27T09:15:04.404 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T09:15:04.441 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.053) 0:01:39.463 ***** 2021-01-27T09:15:04.447 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-27T09:15:04.450 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T09:15:04.486 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.044) 0:01:39.508 ***** 2021-01-27T09:15:04.500 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T09:15:04.538 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.051) 0:01:39.560 ***** 2021-01-27T09:15:04.545 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-27T09:15:04.547 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:04.602 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.064) 0:01:39.624 ***** 2021-01-27T09:15:04.608 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:04.651 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.049) 0:01:39.674 ***** 2021-01-27T09:15:04.775 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-27T09:15:04.778 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T09:15:04.814 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.162) 0:01:39.836 ***** 2021-01-27T09:15:04.842 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T09:15:04.883 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:04 +0000 (0:00:00.069) 0:01:39.906 ***** 2021-01-27T09:15:04.989 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-27T09:15:04.990 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T09:15:05.030 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.147) 0:01:40.053 ***** 2021-01-27T09:15:05.059 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T09:15:05.061 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi047.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T09:15:05.097 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.066) 0:01:40.120 ***** 2021-01-27T09:15:05.135 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.037) 0:01:40.157 ***** 2021-01-27T09:15:05.141 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T09:15:05.143 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.183 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.047) 0:01:40.205 ***** 2021-01-27T09:15:05.193 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-27T09:15:05.194 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.195 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.197 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.244 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.061) 0:01:40.267 ***** 2021-01-27T09:15:05.252 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.254 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.296 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.052) 0:01:40.319 ***** 2021-01-27T09:15:05.303 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-27T09:15:05.305 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.316 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.317 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.061) 0:01:40.381 ***** 2021-01-27T09:15:05.375 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.376 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.378 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi047.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.379 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.421 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.062) 0:01:40.443 ***** 2021-01-27T09:15:05.428 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:15:05.430 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.469 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.048) 0:01:40.491 ***** 2021-01-27T09:15:05.476 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.522 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.053) 0:01:40.545 ***** 2021-01-27T09:15:05.529 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T09:15:05.530 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.565 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.043) 0:01:40.588 ***** 2021-01-27T09:15:05.571 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.609 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.043) 0:01:40.631 ***** 2021-01-27T09:15:05.615 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T09:15:05.617 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.654 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.044) 0:01:40.676 ***** 2021-01-27T09:15:05.660 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.698 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.044) 0:01:40.720 ***** 2021-01-27T09:15:05.704 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T09:15:05.706 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.742 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.043) 0:01:40.764 ***** 2021-01-27T09:15:05.747 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.784 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.042) 0:01:40.806 ***** 2021-01-27T09:15:05.791 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T09:15:05.792 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.832 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.047) 0:01:40.854 ***** 2021-01-27T09:15:05.840 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.885 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.053) 0:01:40.907 ***** 2021-01-27T09:15:05.892 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:15:05.894 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.936 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.050) 0:01:40.958 ***** 2021-01-27T09:15:05.942 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:05.985 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:05 +0000 (0:00:00.049) 0:01:41.007 ***** 2021-01-27T09:15:05.993 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T09:15:05.995 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:06.033 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.048) 0:01:41.056 ***** 2021-01-27T09:15:06.041 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:06.081 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.047) 0:01:41.103 ***** 2021-01-27T09:15:06.087 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:15:06.089 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:06.127 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.046) 0:01:41.150 ***** 2021-01-27T09:15:06.135 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:06.173 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.045) 0:01:41.195 ***** 2021-01-27T09:15:06.326 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:06.328 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi103.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010953", "end": "2021-01-27 09:15:06.730119", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 09:15:06.719166", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.384 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009864", "end": "2021-01-27 09:15:05.560119", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 09:15:05.550255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.503 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.015689", "end": "2021-01-27 09:15:06.900629", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 09:15:06.884940", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.582 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.018415", "end": "2021-01-27 09:15:05.754088", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 09:15:05.735673", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.656 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.004665", "end": "2021-01-27 09:15:07.063521", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 09:15:07.058856", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.742 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005690", "end": "2021-01-27 09:15:05.925449", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 09:15:05.919759", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.826 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015743", "end": "2021-01-27 09:15:07.227033", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 09:15:07.211290", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.831 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:06.872 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.699) 0:01:41.894 ***** 2021-01-27T09:15:06.874 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:06.901 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:06.903 INFO:teuthology.task.ansible.out:TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T09:15:06.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.068) 0:01:41.963 ***** 2021-01-27T09:15:06.947 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T09:15:06.949 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.013196", "end": "2021-01-27 09:15:06.103020", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 09:15:06.089824", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:06.996 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:06 +0000 (0:00:00.055) 0:01:42.019 ***** 2021-01-27T09:15:07.025 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T09:15:07.062 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:07 +0000 (0:00:00.065) 0:01:42.084 ***** 2021-01-27T09:15:07.116 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-27T09:15:07.118 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T09:15:07.254 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T09:15:07.372 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-27T09:15:07.407 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:07 +0000 (0:00:00.345) 0:01:42.430 ***** 2021-01-27T09:15:07.444 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:07 +0000 (0:00:00.036) 0:01:42.466 ***** 2021-01-27T09:15:08.432 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi103.front.sepia.ceph.com] 2021-01-27T09:15:08.612 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] 2021-01-27T09:15:08.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:01.246) 0:01:43.713 ***** 2021-01-27T09:15:08.757 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.065) 0:01:43.779 ***** 2021-01-27T09:15:08.764 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:15:08.766 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T09:15:08.807 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.050) 0:01:43.829 ***** 2021-01-27T09:15:08.814 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T09:15:08.857 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.049) 0:01:43.879 ***** 2021-01-27T09:15:08.864 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:15:08.866 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:08.904 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.046) 0:01:43.926 ***** 2021-01-27T09:15:08.910 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:08.953 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.049) 0:01:43.976 ***** 2021-01-27T09:15:08.960 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-27T09:15:08.962 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T09:15:09.002 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:08 +0000 (0:00:00.047) 0:01:44.024 ***** 2021-01-27T09:15:09.008 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T09:15:09.050 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.048) 0:01:44.072 ***** 2021-01-27T09:15:09.724 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T09:15:09.726 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"cache_update_time": 1611738560, "cache_updated": false, "changed": false} 2021-01-27T09:15:09.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.713) 0:01:44.786 ***** 2021-01-27T09:15:09.791 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:15:09.793 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:09.832 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.068) 0:01:44.855 ***** 2021-01-27T09:15:09.839 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T09:15:09.840 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"cache_update_time": 1611738619, "cache_updated": false, "changed": false} 2021-01-27T09:15:09.883 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.050) 0:01:44.905 ***** 2021-01-27T09:15:09.891 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:15:09.892 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T09:15:09.936 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.053) 0:01:44.958 ***** 2021-01-27T09:15:09.943 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:15:09.945 INFO:teuthology.task.ansible.out:skipping: [smithi047.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:15:10.002 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:09 +0000 (0:00:00.065) 0:01:45.024 ***** 2021-01-27T09:15:10.042 INFO:teuthology.task.ansible.out: 2021-01-27T09:15:10.044 INFO:teuthology.task.ansible.out:TASK [container-host : set_fact] *********************************************** ok: [smithi047.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T09:15:10.083 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:10 +0000 (0:00:00.080) 0:01:45.105 ***** 2021-01-27T09:15:10.165 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-27T09:15:10.167 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:15:10.303 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:15:10.315 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:15:10.359 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:10 +0000 (0:00:00.275) 0:01:45.381 ***** 2021-01-27T09:15:10.481 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:15:10.523 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:10 +0000 (0:00:00.164) 0:01:45.546 ***** 2021-01-27T09:15:10.806 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-27T09:15:10.809 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738910.3973417-170802334940072/source", "state": "file", "uid": 0} 2021-01-27T09:15:11.010 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738910.561649-230101412714224/source", "state": "file", "uid": 0} 2021-01-27T09:15:11.257 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738910.8237495-84158217401119/source", "state": "file", "uid": 0} 2021-01-27T09:15:11.319 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:11 +0000 (0:00:00.795) 0:01:46.342 ***** 2021-01-27T09:15:11.489 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738911.0248804-196625589880811/source", "state": "file", "uid": 0} 2021-01-27T09:15:11.540 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:11 +0000 (0:00:00.220) 0:01:46.562 ***** 2021-01-27T09:15:16.379 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-27T09:15:16.381 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5hzgqm2e\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5hzgqm2e"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-5hzgqm2e\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=95a134e113a98e48001065c60b5c2dab4e3ad2600619d391daa0c05a6010556d\n Stored in directory: /tmp/pip-ephem-wheel-cache-1mtwsd7i/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=c6e5c3adc4df3ce427a3314377a2c5abab5c3949d92da5d9652be935c5142d9d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T09:15:16.383 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-5hzgqm2e", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=95a134e113a98e48001065c60b5c2dab4e3ad2600619d391daa0c05a6010556d", " Stored in directory: /tmp/pip-ephem-wheel-cache-1mtwsd7i/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=c6e5c3adc4df3ce427a3314377a2c5abab5c3949d92da5d9652be935c5142d9d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T09:15:16.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:16 +0000 (0:00:04.879) 0:01:51.442 ***** 2021-01-27T09:15:16.563 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_4fw7sob\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_4fw7sob"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-_4fw7sob\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=95a134e113a98e48001065c60b5c2dab4e3ad2600619d391daa0c05a6010556d\n Stored in directory: /tmp/pip-ephem-wheel-cache-g8mav0u8/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=c6e5c3adc4df3ce427a3314377a2c5abab5c3949d92da5d9652be935c5142d9d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T09:15:16.565 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-_4fw7sob", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=95a134e113a98e48001065c60b5c2dab4e3ad2600619d391daa0c05a6010556d", " Stored in directory: /tmp/pip-ephem-wheel-cache-g8mav0u8/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=c6e5c3adc4df3ce427a3314377a2c5abab5c3949d92da5d9652be935c5142d9d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T09:15:16.603 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:16 +0000 (0:00:00.183) 0:01:51.625 ***** 2021-01-27T09:15:16.615 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T09:15:16.658 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:16 +0000 (0:00:00.054) 0:01:51.680 ***** 2021-01-27T09:15:16.800 INFO:teuthology.task.ansible.out:ok: [smithi047.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T09:15:16.844 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:16 +0000 (0:00:00.185) 0:01:51.866 ***** 2021-01-27T09:15:17.105 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-27T09:15:17.107 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738916.6906302-117889765002626/source", "state": "file", "uid": 0} 2021-01-27T09:15:17.144 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:17 +0000 (0:00:00.300) 0:01:52.166 ***** 2021-01-27T09:15:17.297 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611738916.880074-60028785945260/source", "state": "file", "uid": 0} 2021-01-27T09:15:17.336 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:17 +0000 (0:00:00.191) 0:01:52.358 ***** 2021-01-27T09:15:17.363 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-27T09:15:17.365 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.038170", "end": "2021-01-27 09:15:17.771475", "rc": 0, "start": "2021-01-27 09:15:17.733305", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:17.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:17 +0000 (0:00:00.070) 0:01:52.428 ***** 2021-01-27T09:15:17.569 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.038740", "end": "2021-01-27 09:15:16.753642", "rc": 0, "start": "2021-01-27 09:15:16.714902", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:15:17.609 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:15:17 +0000 (0:00:00.202) 0:01:52.631 ***** 2021-01-27T09:15:21.009 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-27T09:15:21.011 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target firewalld.service network-online.target basic.target containerd.service docker.socket system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T09:15:21.013 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T09:15:21.015 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T09:15:21.018 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:14:10 UTC", "StateChangeTimestampMonotonic": "70140162", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:15:21.271 INFO:teuthology.task.ansible.out:changed: [smithi047.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice network-online.target docker.socket sysinit.target basic.target systemd-journald.socket containerd.service firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T09:15:21.273 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T09:15:21.275 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T09:15:21.277 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:14:09 UTC", "StateChangeTimestampMonotonic": "89283105", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:15:21.381 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-27T09:15:21.385 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-27T09:15:21.389 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2021-01-27T09:15:21.390 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi047.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi103.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Wednesday 27 January 2021 09:15:21 +0000 (0:00:03.780) 0:01:56.412 ***** =============================================================================== 2021-01-27T09:15:21.392 INFO:teuthology.task.ansible.out:testnode : Ensure packages are not present. ---------------------------- 11.67s testnode : Install packages --------------------------------------------- 8.74s testnode : Zap all non-root disks --------------------------------------- 7.66s container-host : Install registries-conf-ctl ---------------------------- 4.88s container-host : Restart docker service --------------------------------- 3.78s common : Update apt cache ----------------------------------------------- 3.02s testnode : Install packages via pip ------------------------------------- 2.82s Gathering Facts --------------------------------------------------------- 2.25s testnode : Create logical volume(s) ------------------------------------- 2.22s testnode : Update apt cache. -------------------------------------------- 2.07s testnode : Install apt keys --------------------------------------------- 2.05s testnode : Install python-pip on apt based systems. --------------------- 1.27s Gathering Facts --------------------------------------------------------- 1.25s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.21s Gathering Facts --------------------------------------------------------- 0.98s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.80s users : Create all admin users with sudo access. ------------------------ 0.78s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.77s container-host : Install container packages ----------------------------- 0.71s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.70s 2021-01-27T09:15:21.716 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2021-01-27T09:15:21.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:15:21.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:15:21.761 DEBUG:teuthology.orchestra.run.smithi103:> true 2021-01-27T09:15:21.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:15:21.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:15:21.960 DEBUG:teuthology.orchestra.run.smithi047:> true 2021-01-27T09:15:22.128 INFO:teuthology.run_tasks:Running task clock... 2021-01-27T09:15:22.149 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-27T09:15:22.149 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T09:15:22.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T09:15:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T09:15:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Command line: ntpd -gq 2021-01-27T09:15:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: proto: precision = 0.140 usec (-23) 2021-01-27T09:15:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:15:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:15:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T09:15:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T09:15:22.187 INFO:teuthology.orchestra.run.smithi103.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:15:22.187 INFO:teuthology.orchestra.run.smithi103.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:15:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T09:15:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen normally on 3 enp3s0f1 172.21.15.103:123 2021-01-27T09:15:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen normally on 4 lo [::1]:123 2021-01-27T09:15:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0b%5]:123 2021-01-27T09:15:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:22 ntpd[5436]: Listening on routing socket on fd #22 for interface updates 2021-01-27T09:15:23.184 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:23.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:23.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:23 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:25 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:26.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:26.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:26.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:26.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:26.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:26.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:26 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:27.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:27.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:27.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:27.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:27.189 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:27.189 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:27.189 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:27.189 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:27 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:28.188 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:28 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:29.185 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:29.186 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:29.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:29.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:29.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:29.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:29.187 INFO:teuthology.orchestra.run.smithi103.stderr:27 Jan 09:15:29 ntpd[5436]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T09:15:29.188 INFO:teuthology.orchestra.run.smithi103.stdout:27 Jan 09:15:29 ntpd[5436]: ntpd: time set -0.433794 s 2021-01-27T09:15:29.188 INFO:teuthology.orchestra.run.smithi103.stdout:ntpd: time set -0.433794s 2021-01-27T09:15:29.257 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T09:15:29.258 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2021-01-27T09:15:29.258 INFO:teuthology.orchestra.run.smithi103.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:29.258 INFO:teuthology.orchestra.run.smithi103.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:29.258 INFO:teuthology.orchestra.run.smithi103.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:29.258 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:29.259 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T09:15:29.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T09:15:29.292 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T09:15:29.293 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Command line: ntpd -gq 2021-01-27T09:15:29.296 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: proto: precision = 0.102 usec (-23) 2021-01-27T09:15:29.296 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:15:29.296 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:15:29.297 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T09:15:29.297 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T09:15:29.297 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T09:15:29.298 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen normally on 3 ens1f0 172.21.15.47:123 2021-01-27T09:15:29.298 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen normally on 4 lo [::1]:123 2021-01-27T09:15:29.299 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%3]:123 2021-01-27T09:15:29.299 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:28 ntpd[5366]: Listening on routing socket on fd #22 for interface updates 2021-01-27T09:15:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:15:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:15:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:29 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:31.293 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:30 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:32.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:32.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:32.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:32.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:32.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:32.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:32.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:32.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:32.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:31 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:33.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:33.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:33.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:33.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:33.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:33.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:32 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:34.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:34.298 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:33 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:35.293 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:35.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:35.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:35.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:35.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:35.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:34 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:15:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:15:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:15:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:35 ntpd[5366]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:15:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:27 Jan 09:15:36 ntpd[5366]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T09:15:36.296 INFO:teuthology.orchestra.run.smithi047.stdout:27 Jan 09:15:36 ntpd[5366]: ntpd: time set +0.788095 s 2021-01-27T09:15:36.297 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time set +0.788095s 2021-01-27T09:15:36.347 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T09:15:36.348 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2021-01-27T09:15:36.348 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:36.348 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:36.348 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:36.349 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:15:36.349 INFO:teuthology.run_tasks:Running task install... 2021-01-27T09:15:36.361 DEBUG:teuthology.task.install:project ceph 2021-01-27T09:15:36.361 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '507028cb839c25d6666833702df6325fd8569096'}} 2021-01-27T09:15:36.362 DEBUG:teuthology.task.install:config {'sha1': '507028cb839c25d6666833702df6325fd8569096'} 2021-01-27T09:15:36.362 INFO:teuthology.task.install:Using flavor: basic 2021-01-27T09:15:36.370 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-27T09:15:36.370 INFO:teuthology.task.install:extra packages: [] 2021-01-27T09:15:36.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2021-01-27T09:15:36.422 INFO:teuthology.orchestra.run.smithi103.stdout:Ubuntu 2021-01-27T09:15:36.427 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:15:36.428 DEBUG:teuthology.orchestra.run.smithi047:> sudo lsb_release -is 2021-01-27T09:15:36.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-key list | grep Ceph 2021-01-27T09:15:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:Ubuntu 2021-01-27T09:15:36.483 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:15:36.484 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2021-01-27T09:15:36.523 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T09:15:36.578 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T09:15:36.579 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T09:15:36.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2021-01-27T09:15:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T09:15:36.627 INFO:teuthology.orchestra.run.smithi103.stdout:Ubuntu 2021-01-27T09:15:36.632 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:15:36.632 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T09:15:36.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:15:36.654 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T09:15:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T09:15:36.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo lsb_release -is 2021-01-27T09:15:36.705 INFO:teuthology.orchestra.run.smithi047.stdout:Ubuntu 2021-01-27T09:15:36.711 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:15:36.711 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T09:15:36.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:15:36.816 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-27T09:15:36.816 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-27T09:15:36.886 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-27T09:15:36.888 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-27T09:15:36.952 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:15:36.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T09:15:36.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2021-01-27T09:15:37.019 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:15:37.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T09:15:37.039 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2021-01-27T09:15:37.221 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-27T09:15:37.243 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-27T09:15:37.244 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T09:15:37.268 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T09:15:37.279 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:15:37.280 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T09:15:37.280 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T09:15:37.304 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:15:37.304 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T09:15:37.305 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T09:15:37.305 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T09:15:37.328 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T09:15:37.347 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T09:15:37.350 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-27T09:15:37.371 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T09:15:37.376 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-27T09:15:37.434 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T09:15:37.456 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T09:15:37.931 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 27.3 kB in 1s (36.4 kB/s) 2021-01-27T09:15:37.988 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 27.3 kB in 1s (34.6 kB/s) 2021-01-27T09:15:38.646 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:15:38.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-27T09:15:38.730 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:15:38.735 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2021-01-27T09:15:38.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-27T09:15:38.820 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2021-01-27T09:15:38.888 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2021-01-27T09:15:38.888 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2021-01-27T09:15:38.978 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2021-01-27T09:15:38.979 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2021-01-27T09:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.71.0 2021-01-27T09:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2021-01-27T09:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T09:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T09:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T09:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T09:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T09:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T09:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T09:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T09:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T09:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T09:15:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T09:15:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T09:15:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T09:15:39.029 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2021-01-27T09:15:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T09:15:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T09:15:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T09:15:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T09:15:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T09:15:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T09:15:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T09:15:39.030 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2021-01-27T09:15:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: btrfs-tools 2021-01-27T09:15:39.116 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2021-01-27T09:15:39.117 INFO:teuthology.orchestra.run.smithi103.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T09:15:39.117 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T09:15:39.117 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T09:15:39.119 INFO:teuthology.orchestra.run.smithi047.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:15:39.119 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T09:15:39.120 INFO:teuthology.orchestra.run.smithi103.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T09:15:39.120 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T09:15:39.120 INFO:teuthology.orchestra.run.smithi103.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T09:15:39.120 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T09:15:39.120 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T09:15:39.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T09:15:39.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T09:15:39.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T09:15:39.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T09:15:39.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:15:39.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T09:15:39.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T09:15:39.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T09:15:39.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T09:15:39.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T09:15:39.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T09:15:39.123 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse socat xmlstarlet 2021-01-27T09:15:39.123 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2021-01-27T09:15:39.123 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 librbd1 2021-01-27T09:15:39.125 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.71.0 2021-01-27T09:15:39.125 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:15:39.125 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2021-01-27T09:15:39.126 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T09:15:39.126 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T09:15:39.126 INFO:teuthology.orchestra.run.smithi047.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:15:39.126 INFO:teuthology.orchestra.run.smithi047.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:15:39.127 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:15:39.127 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:15:39.127 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T09:15:39.127 INFO:teuthology.orchestra.run.smithi047.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T09:15:39.127 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T09:15:39.128 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T09:15:39.128 INFO:teuthology.orchestra.run.smithi047.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T09:15:39.128 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:15:39.128 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T09:15:39.128 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T09:15:39.129 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T09:15:39.129 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T09:15:39.129 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T09:15:39.129 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T09:15:39.129 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2021-01-27T09:15:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T09:15:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T09:15:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T09:15:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T09:15:39.130 INFO:teuthology.orchestra.run.smithi047.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T09:15:39.131 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T09:15:39.131 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T09:15:39.131 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2021-01-27T09:15:39.131 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2021-01-27T09:15:39.214 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2021-01-27T09:15:39.215 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T09:15:39.215 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T09:15:39.215 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T09:15:39.216 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T09:15:39.216 INFO:teuthology.orchestra.run.smithi047.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T09:15:39.217 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T09:15:39.217 INFO:teuthology.orchestra.run.smithi047.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T09:15:39.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T09:15:39.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T09:15:39.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T09:15:39.218 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T09:15:39.219 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T09:15:39.219 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T09:15:39.219 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:15:39.219 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T09:15:39.219 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T09:15:39.220 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T09:15:39.220 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T09:15:39.220 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T09:15:39.220 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T09:15:39.221 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse socat xmlstarlet 2021-01-27T09:15:39.221 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2021-01-27T09:15:39.221 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 librbd1 2021-01-27T09:15:39.257 INFO:teuthology.orchestra.run.smithi103.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:15:39.258 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 169 MB of archives. 2021-01-27T09:15:39.258 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T09:15:39.258 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-27T09:15:39.305 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-27T09:15:39.306 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T09:15:39.357 INFO:teuthology.orchestra.run.smithi047.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T09:15:39.358 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 169 MB of archives. 2021-01-27T09:15:39.358 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T09:15:39.358 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-27T09:15:39.403 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T09:15:39.405 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-27T09:15:39.631 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-27T09:15:39.682 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T09:15:39.691 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T09:15:39.693 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T09:15:39.730 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-27T09:15:39.765 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T09:15:39.773 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T09:15:39.775 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T09:15:39.824 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-27T09:15:39.843 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T09:15:39.861 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-27T09:15:39.869 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T09:15:39.876 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T09:15:39.882 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T09:15:39.887 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T09:15:39.888 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-27T09:15:39.889 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-27T09:15:39.907 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T09:15:39.908 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-27T09:15:39.910 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T09:15:39.911 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-27T09:15:39.913 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T09:15:39.915 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T09:15:39.924 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T09:15:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-27T09:15:39.925 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T09:15:39.944 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T09:15:39.951 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T09:15:39.957 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T09:15:39.962 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T09:15:39.974 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-27T09:15:39.984 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T09:15:39.986 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T09:15:39.987 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T09:15:39.994 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T09:15:40.005 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T09:15:40.006 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T09:15:40.009 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T09:15:40.011 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T09:15:40.015 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T09:15:40.019 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T09:15:40.020 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T09:15:40.035 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-27T09:15:40.046 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T09:15:40.046 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T09:15:40.055 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-27T09:15:40.056 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-27T09:15:40.076 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T09:15:40.080 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T09:15:40.081 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T09:15:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-27T09:15:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-27T09:15:40.086 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T09:15:40.086 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T09:15:40.087 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T09:15:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T09:15:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T09:15:40.099 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-27T09:15:40.118 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T09:15:40.118 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T09:15:40.119 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T09:15:40.144 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-27T09:15:40.147 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-27T09:15:40.165 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-27T09:15:40.166 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T09:15:40.170 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T09:15:40.172 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T09:15:40.174 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T09:15:40.174 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T09:15:40.175 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T09:15:40.177 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T09:15:40.179 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T09:15:40.180 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T09:15:40.180 INFO:teuthology.orchestra.run.smithi103.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T09:15:40.184 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T09:15:40.189 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T09:15:40.247 INFO:teuthology.orchestra.run.smithi103.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T09:15:40.250 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T09:15:40.254 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T09:15:40.257 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T09:15:40.261 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T09:15:40.262 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T09:15:40.263 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T09:15:40.378 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-27T09:15:40.380 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-27T09:15:40.395 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-27T09:15:40.544 INFO:teuthology.orchestra.run.smithi103.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T09:15:40.615 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T09:15:40.616 INFO:teuthology.orchestra.run.smithi103.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T09:15:40.618 INFO:teuthology.orchestra.run.smithi103.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T09:15:40.665 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T09:15:40.666 INFO:teuthology.orchestra.run.smithi103.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T09:15:40.667 INFO:teuthology.orchestra.run.smithi103.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T09:15:40.682 INFO:teuthology.orchestra.run.smithi103.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T09:15:40.685 INFO:teuthology.orchestra.run.smithi103.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T09:15:40.686 INFO:teuthology.orchestra.run.smithi103.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T09:15:40.686 INFO:teuthology.orchestra.run.smithi103.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T09:15:40.687 INFO:teuthology.orchestra.run.smithi103.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T09:15:40.689 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T09:15:40.707 INFO:teuthology.orchestra.run.smithi103.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T09:15:40.712 INFO:teuthology.orchestra.run.smithi103.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T09:15:40.736 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T09:15:40.736 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T09:15:40.737 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T09:15:40.738 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T09:15:40.738 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T09:15:40.739 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T09:15:40.740 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T09:15:40.778 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T09:15:40.783 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T09:15:40.788 INFO:teuthology.orchestra.run.smithi103.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T09:15:40.788 INFO:teuthology.orchestra.run.smithi103.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T09:15:40.792 INFO:teuthology.orchestra.run.smithi103.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T09:15:40.795 INFO:teuthology.orchestra.run.smithi103.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T09:15:40.797 INFO:teuthology.orchestra.run.smithi103.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T09:15:40.800 INFO:teuthology.orchestra.run.smithi103.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T09:15:40.802 INFO:teuthology.orchestra.run.smithi103.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T09:15:40.806 INFO:teuthology.orchestra.run.smithi103.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T09:15:40.859 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T09:15:40.860 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T09:15:40.863 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T09:15:40.867 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T09:15:40.868 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T09:15:40.869 INFO:teuthology.orchestra.run.smithi103.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T09:15:40.869 INFO:teuthology.orchestra.run.smithi103.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T09:15:40.871 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T09:15:40.873 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T09:15:40.876 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T09:15:40.939 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T09:15:40.940 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T09:15:40.949 INFO:teuthology.orchestra.run.smithi103.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T09:15:40.951 INFO:teuthology.orchestra.run.smithi103.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T09:15:40.970 INFO:teuthology.orchestra.run.smithi103.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T09:15:40.971 INFO:teuthology.orchestra.run.smithi103.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T09:15:40.971 INFO:teuthology.orchestra.run.smithi103.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T09:15:40.972 INFO:teuthology.orchestra.run.smithi103.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T09:15:40.972 INFO:teuthology.orchestra.run.smithi103.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T09:15:40.973 INFO:teuthology.orchestra.run.smithi103.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T09:15:41.020 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T09:15:41.022 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T09:15:41.030 INFO:teuthology.orchestra.run.smithi103.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T09:15:41.031 INFO:teuthology.orchestra.run.smithi103.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T09:15:41.040 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T09:15:41.041 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T09:15:41.041 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T09:15:41.042 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T09:15:41.043 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T09:15:41.043 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T09:15:41.101 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T09:15:41.101 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T09:15:41.563 INFO:teuthology.orchestra.run.smithi103.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-27T09:15:41.800 INFO:teuthology.orchestra.run.smithi103.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-27T09:15:41.805 INFO:teuthology.orchestra.run.smithi103.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-27T09:15:41.890 INFO:teuthology.orchestra.run.smithi103.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-27T09:15:42.159 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-27T09:15:42.277 INFO:teuthology.orchestra.run.smithi103.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-27T09:15:42.536 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-27T09:15:42.553 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-27T09:15:42.640 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-27T09:15:43.231 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-27T09:15:43.909 INFO:teuthology.orchestra.run.smithi103.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-27T09:15:43.910 INFO:teuthology.orchestra.run.smithi103.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-27T09:15:43.924 INFO:teuthology.orchestra.run.smithi103.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-27T09:15:43.966 INFO:teuthology.orchestra.run.smithi103.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-27T09:15:43.968 INFO:teuthology.orchestra.run.smithi103.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-27T09:15:43.969 INFO:teuthology.orchestra.run.smithi103.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-27T09:15:44.090 INFO:teuthology.orchestra.run.smithi103.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-27T09:15:44.555 INFO:teuthology.orchestra.run.smithi103.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-27T09:15:44.555 INFO:teuthology.orchestra.run.smithi103.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-27T09:15:44.556 INFO:teuthology.orchestra.run.smithi103.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-27T09:15:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-27T09:15:45.308 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-27T09:15:45.322 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-27T09:15:45.416 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-27T09:15:45.417 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-27T09:15:45.419 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-27T09:15:45.603 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-27T09:15:46.236 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-27T09:15:46.236 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-27T09:15:46.237 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-27T09:15:47.682 INFO:teuthology.orchestra.run.smithi103.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-27T09:15:47.682 INFO:teuthology.orchestra.run.smithi103.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-27T09:15:48.184 INFO:teuthology.orchestra.run.smithi103.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-27T09:15:48.797 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 169 MB in 9s (18.7 MB/s) 2021-01-27T09:15:48.891 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjaeger. 2021-01-27T09:15:48.949 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T09:15:48.954 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:49.005 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:49.309 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T09:15:49.315 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-27T09:15:49.316 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-27T09:15:49.326 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T09:15:49.401 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:15:49.593 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-27T09:15:49.708 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:49.830 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:15:50.214 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 169 MB in 10s (16.3 MB/s) 2021-01-27T09:15:50.304 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjaeger. 2021-01-27T09:15:50.363 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T09:15:50.367 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:50.410 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:50.510 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:50.660 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:15:50.763 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T09:15:50.781 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T09:15:50.863 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:15:51.194 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:51.294 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:15:51.314 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T09:15:51.333 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:51.372 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:51.717 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rados. 2021-01-27T09:15:51.734 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:51.775 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:52.153 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T09:15:52.163 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:52.170 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:15:52.211 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:52.305 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:15:52.447 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T09:15:52.464 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:52.506 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T09:15:52.851 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:15:52.892 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:52.984 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T09:15:53.001 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:53.042 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:53.204 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T09:15:53.221 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T09:15:53.278 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T09:15:53.370 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2021-01-27T09:15:53.390 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:53.419 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:53.540 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T09:15:53.558 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:53.590 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:53.789 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T09:15:53.807 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:15:53.847 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:53.977 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T09:15:53.994 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T09:15:54.034 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:15:54.116 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T09:15:54.137 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:54.174 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:54.371 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T09:15:54.388 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T09:15:54.429 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:15:54.511 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T09:15:54.530 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:15:54.569 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:54.775 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librgw2. 2021-01-27T09:15:54.793 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:54.824 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:54.864 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T09:15:54.883 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T09:15:54.913 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T09:15:55.166 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T09:15:55.184 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:55.257 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:55.402 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T09:15:55.421 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:55.461 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:55.636 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T09:15:55.655 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T09:15:55.711 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:15:55.780 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T09:15:55.798 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T09:15:55.838 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:15:55.989 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T09:15:56.006 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T09:15:56.038 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:15:56.166 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liboath0. 2021-01-27T09:15:56.185 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T09:15:56.225 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T09:15:56.506 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2021-01-27T09:15:56.526 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:56.528 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T09:15:56.546 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:56.566 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:56.586 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:56.981 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-common. 2021-01-27T09:15:56.998 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:57.031 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:57.161 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T09:15:57.179 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:57.219 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:57.572 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T09:15:57.591 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T09:15:57.630 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:15:57.958 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0. 2021-01-27T09:15:57.978 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T09:15:58.016 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T09:15:58.352 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T09:15:58.371 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:58.410 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:58.881 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2021-01-27T09:15:58.898 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:58.938 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:15:59.387 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-base. 2021-01-27T09:15:59.403 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:15:59.456 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:00.426 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T09:16:00.445 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T09:16:00.475 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T09:16:00.720 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T09:16:00.740 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:00.778 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:01.159 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T09:16:01.175 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T09:16:01.217 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:16:01.419 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2021-01-27T09:16:01.436 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:01.488 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:01.691 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T09:16:01.712 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T09:16:01.753 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:16:02.132 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T09:16:02.149 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T09:16:02.198 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T09:16:02.482 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T09:16:02.499 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T09:16:02.501 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T09:16:02.518 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T09:16:02.531 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T09:16:02.560 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:16:02.784 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T09:16:02.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:02.863 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-mako. 2021-01-27T09:16:02.867 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:02.884 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T09:16:02.921 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:16:03.197 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T09:16:03.215 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T09:16:03.255 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:16:03.318 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T09:16:03.335 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T09:16:03.385 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:16:03.542 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T09:16:03.559 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T09:16:03.600 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:16:03.688 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T09:16:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T09:16:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:16:03.987 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T09:16:04.004 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T09:16:04.032 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webob. 2021-01-27T09:16:04.045 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T09:16:04.052 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T09:16:04.090 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T09:16:04.398 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T09:16:04.410 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T09:16:04.418 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T09:16:04.427 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T09:16:04.456 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:16:04.493 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:16:04.792 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2021-01-27T09:16:04.804 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T09:16:04.809 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T09:16:04.822 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T09:16:04.851 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:16:04.871 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T09:16:05.212 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T09:16:05.229 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T09:16:05.249 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T09:16:05.266 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T09:16:05.270 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:16:05.310 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T09:16:05.598 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T09:16:05.618 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T09:16:05.656 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:16:05.669 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T09:16:05.686 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T09:16:05.727 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T09:16:06.018 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2021-01-27T09:16:06.035 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T09:16:06.055 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-paste. 2021-01-27T09:16:06.072 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T09:16:06.075 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T09:16:06.114 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:16:06.420 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T09:16:06.441 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T09:16:06.442 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T09:16:06.458 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T09:16:06.478 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:16:06.499 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:16:06.786 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T09:16:06.805 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T09:16:06.807 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T09:16:06.824 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T09:16:06.844 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:16:06.864 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T09:16:07.114 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T09:16:07.130 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T09:16:07.172 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T09:16:07.243 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T09:16:07.261 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T09:16:07.304 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T09:16:07.500 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T09:16:07.518 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T09:16:07.558 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:16:07.663 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T09:16:07.680 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T09:16:07.721 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T09:16:07.913 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T09:16:07.933 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T09:16:07.971 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:16:08.041 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2021-01-27T09:16:08.059 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T09:16:08.099 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:16:08.316 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T09:16:08.333 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:08.374 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:08.461 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T09:16:08.478 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T09:16:08.518 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:16:08.819 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T09:16:08.840 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:08.877 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:08.882 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T09:16:08.899 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T09:16:08.948 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:16:09.293 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T09:16:09.311 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T09:16:09.351 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T09:16:09.696 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T09:16:09.716 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T09:16:09.754 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:16:09.956 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T09:16:09.974 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:10.039 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:10.134 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T09:16:10.151 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T09:16:10.192 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:16:10.570 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T09:16:10.590 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:10.628 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:11.232 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T09:16:11.249 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:11.290 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:12.970 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph. 2021-01-27T09:16:12.986 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:13.027 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T09:16:13.028 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:13.044 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:13.102 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:13.314 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T09:16:13.332 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:13.372 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:13.784 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T09:16:13.802 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:13.842 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:14.387 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephadm. 2021-01-27T09:16:14.403 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:14.445 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:14.740 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T09:16:14.760 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T09:16:14.798 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T09:16:15.079 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T09:16:15.094 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:15.134 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:15.462 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T09:16:15.481 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T09:16:15.537 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T09:16:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T09:16:15.774 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2021-01-27T09:16:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T09:16:15.791 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:16:15.832 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T09:16:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T09:16:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:16:16.176 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T09:16:16.195 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:16.243 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-routes. 2021-01-27T09:16:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T09:16:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T09:16:16.680 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T09:16:16.701 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:16.738 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T09:16:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:17.424 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2021-01-27T09:16:17.443 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:17.483 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:17.828 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T09:16:17.846 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T09:16:17.977 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T09:16:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T09:16:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T09:16:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:16:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T09:16:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T09:16:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:16:18.531 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T09:16:18.547 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:18.596 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T09:16:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T09:16:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T09:16:18.975 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T09:16:18.992 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T09:16:19.033 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T09:16:19.294 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T09:16:19.312 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T09:16:19.352 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:16:19.639 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T09:16:19.657 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T09:16:19.696 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:16:20.041 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2021-01-27T09:16:20.059 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T09:16:20.099 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T09:16:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T09:16:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T09:16:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:20.444 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T09:16:20.461 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:20.503 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T09:16:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T09:16:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T09:16:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T09:16:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T09:16:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:21.427 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T09:16:21.444 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T09:16:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:16:21.855 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T09:16:21.872 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T09:16:21.913 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:16:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T09:16:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:22.241 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T09:16:22.258 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T09:16:22.299 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T09:16:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T09:16:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T09:16:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T09:16:23.693 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T09:16:23.710 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T09:16:23.714 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T09:16:23.727 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T09:16:23.776 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:23.793 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:16:24.130 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T09:16:24.147 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T09:16:24.188 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:16:24.355 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T09:16:24.374 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T09:16:24.413 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T09:16:24.500 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T09:16:24.521 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T09:16:24.558 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T09:16:24.775 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T09:16:24.793 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T09:16:24.833 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:24.844 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T09:16:24.861 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T09:16:24.902 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T09:16:25.239 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T09:16:25.256 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T09:16:25.297 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:16:25.559 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T09:16:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:25.592 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T09:16:25.612 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T09:16:25.616 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:25.650 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:16:25.961 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T09:16:25.978 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T09:16:26.019 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:16:26.591 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T09:16:26.610 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:26.649 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:26.736 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T09:16:26.757 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T09:16:26.819 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T09:16:27.002 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T09:16:27.019 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T09:16:27.060 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:16:27.156 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T09:16:27.174 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T09:16:27.247 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:16:27.389 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T09:16:27.406 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T09:16:27.446 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T09:16:27.584 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T09:16:27.603 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T09:16:27.675 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:16:27.751 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T09:16:27.767 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:27.808 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:27.987 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T09:16:28.006 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T09:16:28.078 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T09:16:28.186 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T09:16:28.205 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T09:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:16:28.399 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T09:16:28.416 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T09:16:28.482 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T09:16:28.606 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T09:16:28.622 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:16:28.664 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:16:28.810 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T09:16:28.827 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T09:16:28.893 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package jq. 2021-01-27T09:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:16:29.221 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T09:16:29.239 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T09:16:29.257 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package socat. 2021-01-27T09:16:29.277 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T09:16:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T09:16:29.321 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:16:29.649 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T09:16:29.664 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T09:16:29.667 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T09:16:29.682 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T09:16:29.722 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:16:29.741 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:16:30.053 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-test. 2021-01-27T09:16:30.070 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:30.109 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:30.312 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T09:16:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:30.370 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:30.732 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T09:16:30.750 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T09:16:30.790 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:16:31.143 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T09:16:31.160 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T09:16:31.201 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T09:16:31.554 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T09:16:31.571 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T09:16:31.612 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:31.966 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T09:16:31.985 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T09:16:32.023 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:16:32.385 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T09:16:32.406 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:16:32.460 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:16:32.779 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2021-01-27T09:16:32.798 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:16:32.845 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:16:33.148 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2021-01-27T09:16:33.169 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T09:16:33.206 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T09:16:33.527 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T09:16:33.546 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T09:16:33.584 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:16:33.989 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2021-01-27T09:16:34.007 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:34.055 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:34.305 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T09:16:34.324 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:34.362 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:34.758 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T09:16:34.777 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T09:16:34.859 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:16:35.373 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T09:16:35.391 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T09:16:35.431 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:16:35.734 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-attr. 2021-01-27T09:16:35.751 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T09:16:35.792 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T09:16:36.128 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T09:16:36.149 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T09:16:36.236 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:16:36.556 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T09:16:36.576 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T09:16:36.614 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T09:16:36.967 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T09:16:36.985 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T09:16:37.025 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T09:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T09:16:37.537 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T09:16:37.865 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T09:16:37.882 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T09:16:37.923 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T09:16:38.310 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T09:16:38.317 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T09:16:38.327 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T09:16:38.335 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:38.368 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T09:16:38.375 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:38.672 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T09:16:38.690 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T09:16:38.729 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:16:38.795 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T09:16:38.812 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T09:16:38.871 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:16:39.091 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-py. 2021-01-27T09:16:39.110 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T09:16:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T09:16:39.385 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T09:16:39.403 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T09:16:39.469 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T09:16:39.476 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:16:39.486 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T09:16:39.527 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:16:39.779 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-attr. 2021-01-27T09:16:39.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T09:16:39.842 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T09:16:39.857 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T09:16:39.858 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T09:16:39.897 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:16:40.192 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T09:16:40.209 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T09:16:40.213 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T09:16:40.225 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T09:16:40.258 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T09:16:40.307 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:16:40.643 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T09:16:40.665 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T09:16:40.729 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package radosgw. 2021-01-27T09:16:40.735 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T09:16:40.747 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:40.787 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:41.088 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T09:16:41.107 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T09:16:41.171 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:16:41.667 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T09:16:41.684 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T09:16:41.724 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T09:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T09:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:42.053 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T09:16:42.070 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T09:16:42.110 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T09:16:42.260 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T09:16:42.464 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T09:16:42.483 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T09:16:42.522 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T09:16:42.597 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:16:42.721 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:16:42.847 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:16:42.851 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T09:16:42.870 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T09:16:42.909 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:43.212 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2021-01-27T09:16:43.233 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T09:16:43.295 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T09:16:43.615 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T09:16:43.634 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T09:16:43.706 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:16:43.752 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user cephadm....done 2021-01-27T09:16:43.914 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T09:16:44.018 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T09:16:44.035 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T09:16:44.101 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:16:44.316 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T09:16:44.379 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T09:16:44.399 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T09:16:44.428 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T09:16:44.592 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T09:16:44.734 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T09:16:44.908 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2021-01-27T09:16:44.929 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:44.991 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:45.069 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T09:16:45.465 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T09:16:45.749 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T09:16:46.059 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:16:46.162 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T09:16:46.179 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T09:16:46.219 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:46.352 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:16:46.549 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T09:16:46.645 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:46.891 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:16:46.929 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:47.017 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:16:47.156 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:16:47.319 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:47.373 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:16:47.994 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2021-01-27T09:16:48.042 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:16:48.159 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T09:16:48.318 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:16:48.510 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T09:16:48.611 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:49.153 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T09:16:49.279 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T09:16:49.280 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T09:16:49.614 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T09:16:49.622 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T09:16:49.940 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T09:16:50.041 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T09:16:50.266 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:16:50.334 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T09:16:50.392 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:16:50.651 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:16:50.677 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:16:50.902 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:16:51.087 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:16:51.187 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:51.447 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T09:16:51.513 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:51.658 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:16:51.908 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T09:16:51.926 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:16:52.202 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:16:52.259 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:16:52.385 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:16:52.511 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T09:16:52.561 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:16:52.813 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:16:53.089 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:16:53.163 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:53.289 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T09:16:53.416 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:16:53.657 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T09:16:53.733 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:16:54.018 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T09:16:54.058 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T09:16:54.334 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:16:54.436 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:54.452 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:16:54.562 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:16:54.688 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:16:54.745 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:16:54.964 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T09:16:55.138 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:16:55.514 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T09:16:55.550 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:16:55.640 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:55.934 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T09:16:55.958 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T09:16:56.186 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:16:56.285 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:16:56.411 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:16:56.537 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T09:16:56.588 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:16:56.830 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:16:57.130 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:16:57.266 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:16:57.392 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:16:57.457 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:16:57.518 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T09:16:57.825 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:16:57.861 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:57.987 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T09:16:58.101 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T09:16:58.402 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:58.530 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:16:58.654 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:16:58.997 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T09:16:59.298 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:16:59.452 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:16:59.578 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:16:59.641 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:16:59.729 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T09:16:59.994 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T09:17:00.172 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T09:17:00.252 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:17:00.259 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T09:17:00.378 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:17:00.491 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:17:00.704 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:17:00.792 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T09:17:01.030 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:17:01.152 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:01.278 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:01.404 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:17:01.407 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:17:01.541 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:17:01.734 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T09:17:01.738 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:17:02.127 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:02.253 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T09:17:02.769 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:02.895 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:17:03.038 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:17:03.173 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T09:17:03.474 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T09:17:03.784 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:03.926 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:17:04.020 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:17:04.021 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:17:04.061 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T09:17:04.429 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T09:17:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T09:17:04.527 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:04.653 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T09:17:04.755 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:17:04.971 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:17:05.057 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T09:17:05.349 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:05.450 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:05.479 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:05.576 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:05.601 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:05.727 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:17:05.727 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T09:17:06.045 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T09:17:06.061 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:17:06.363 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:06.514 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:06.674 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:17:07.125 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:07.251 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:17:07.402 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:17:07.553 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T09:17:07.585 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:07.838 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T09:17:08.172 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:08.250 INFO:teuthology.orchestra.run.smithi103.stdout:Adding group ceph....done 2021-01-27T09:17:08.397 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:17:08.397 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:17:08.618 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user ceph....done 2021-01-27T09:17:08.819 INFO:teuthology.orchestra.run.smithi103.stdout:Setting system user ceph properties....done 2021-01-27T09:17:08.882 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:08.989 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T09:17:09.016 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T09:17:09.312 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T09:17:09.343 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:17:09.720 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:09.807 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:09.846 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:09.908 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:09.972 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:10.114 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T09:17:10.178 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:17:10.179 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:17:10.441 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T09:17:10.759 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:10.902 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:10.910 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:11.052 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:17:11.234 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T09:17:11.712 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:11.929 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:17:11.930 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:17:12.022 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:12.617 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:17:12.618 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:17:12.744 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2021-01-27T09:17:13.107 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:13.129 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2021-01-27T09:17:13.249 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:13.314 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2021-01-27T09:17:13.491 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T09:17:13.788 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:17:13.789 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:17:13.843 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T09:17:14.276 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:14.335 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:14.402 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:14.502 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:14.545 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:14.764 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:17:14.765 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:17:14.800 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:17:14.801 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:17:15.255 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:15.390 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:15.521 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T09:17:15.865 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T09:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:17:16.339 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:16.576 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:17:16.576 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:17:17.074 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:17.344 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:17:17.344 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:17:17.826 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:17.977 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:18.555 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:17:18.556 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:17:19.037 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:19.186 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:19.331 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:19.446 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:17:19.449 DEBUG:teuthology.parallel:result is None 2021-01-27T09:17:19.559 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:17:19.559 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:17:20.141 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:20.292 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:20.436 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T09:17:20.587 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T09:17:20.904 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:17:24.123 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:17:24.547 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:17:24.550 DEBUG:teuthology.parallel:result is None 2021-01-27T09:17:24.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2021-01-27T09:17:24.604 INFO:teuthology.orchestra.run.smithi103.stdout:Ubuntu 2021-01-27T09:17:24.610 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:17:24.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:24.779 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-query -W -f '${Version}' ceph 2021-01-27T09:17:24.804 INFO:teuthology.orchestra.run.smithi103.stdout:17.0.0-184-g507028cb-1focal 2021-01-27T09:17:24.805 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-27T09:17:24.805 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-27T09:17:24.806 DEBUG:teuthology.orchestra.run.smithi047:> sudo lsb_release -is 2021-01-27T09:17:24.857 INFO:teuthology.orchestra.run.smithi047.stdout:Ubuntu 2021-01-27T09:17:24.863 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:17:24.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:25.027 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2021-01-27T09:17:25.053 INFO:teuthology.orchestra.run.smithi047.stdout:17.0.0-184-g507028cb-1focal 2021-01-27T09:17:25.053 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-27T09:17:25.054 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-27T09:17:25.054 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-27T09:17:25.055 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:17:25.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T09:17:25.071 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:17:25.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T09:17:25.088 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-27T09:17:25.089 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:17:25.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T09:17:25.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T09:17:25.163 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:17:25.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T09:17:25.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T09:17:25.192 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-27T09:17:25.193 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:17:25.193 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T09:17:25.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T09:17:25.261 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:17:25.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T09:17:25.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T09:17:25.294 INFO:teuthology.run_tasks:Running task cephadm... 2021-01-27T09:17:25.363 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '507028cb839c25d6666833702df6325fd8569096', 'cephadm_mode': 'root'} 2021-01-27T09:17:25.364 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:25.365 INFO:tasks.cephadm:Cluster fsid is 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:25.365 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-01-27T09:17:25.366 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.103', 'mon.c': '[v2:172.21.15.103:3301,v1:172.21.15.103:6790]', 'mon.b': '172.21.15.47'} 2021-01-27T09:17:25.366 INFO:tasks.cephadm:First mon is mon.a on smithi103 2021-01-27T09:17:25.366 INFO:tasks.cephadm:First mgr is y 2021-01-27T09:17:25.367 INFO:tasks.cephadm:Normalizing hostnames... 2021-01-27T09:17:25.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2021-01-27T09:17:25.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2021-01-27T09:17:25.399 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 507028cb839c25d6666833702df6325fd8569096)... 2021-01-27T09:17:25.400 DEBUG:teuthology.orchestra.run.smithi047:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-27T09:17:25.504 DEBUG:teuthology.orchestra.run.smithi103:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-27T09:17:25.598 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-27T09:17:25.607 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-27T09:17:25.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2021-01-27T09:17:25.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2021-01-27T09:17:25.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2021-01-27T09:17:25.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2021-01-27T09:17:25.737 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-01-27T09:17:25.738 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:17:25.738 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T09:17:25.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:17:25.745 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi103.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T09:17:25.745 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:17:25.746 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T09:17:25.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:17:25.753 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi047.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T09:17:25.753 INFO:tasks.cephadm:Writing seed config... 2021-01-27T09:17:25.754 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-01-27T09:17:25.755 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-01-27T09:17:25.755 INFO:tasks.cephadm: override: [client] debug ms = 1 2021-01-27T09:17:25.755 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-01-27T09:17:25.756 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2021-01-27T09:17:25.756 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2021-01-27T09:17:25.756 INFO:tasks.cephadm: override: [global] ms type = async 2021-01-27T09:17:25.756 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-01-27T09:17:25.757 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-01-27T09:17:25.757 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-01-27T09:17:25.757 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2021-01-27T09:17:25.758 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-01-27T09:17:25.758 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-01-27T09:17:25.758 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-01-27T09:17:25.758 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-01-27T09:17:25.759 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-01-27T09:17:25.760 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:17:25.760 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-01-27T09:17:25.767 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 78337516-6080-11eb-8f9a-001a4aab830c mon election default strategy = 3 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2021-01-27T09:17:25.767 DEBUG:teuthology.orchestra.run.smithi103:mon.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a.service 2021-01-27T09:17:25.770 DEBUG:teuthology.orchestra.run.smithi103:mgr.y> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y.service 2021-01-27T09:17:25.813 INFO:tasks.cephadm:Bootstrapping... 2021-01-27T09:17:25.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -v bootstrap --fsid 78337516-6080-11eb-8f9a-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.103 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-01-27T09:17:25.817 INFO:journalctl@ceph.mon.a.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:17:25.842 INFO:journalctl@ceph.mgr.y.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:17:26.060 INFO:teuthology.orchestra.run.smithi103.stderr:Could not locate podman: podman not found 2021-01-27T09:17:26.060 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying podman|docker is present... 2021-01-27T09:17:26.061 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying lvm2 is present... 2021-01-27T09:17:26.061 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying time synchronization is in place... 2021-01-27T09:17:26.061 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T09:17:26.066 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-27T09:17:26.067 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active chrony.service 2021-01-27T09:17:26.072 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.073 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T09:17:26.079 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-27T09:17:26.079 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T09:17:26.085 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.086 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T09:17:26.092 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: masked 2021-01-27T09:17:26.093 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T09:17:26.100 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.101 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T09:17:26.107 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-27T09:17:26.108 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T09:17:26.113 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.114 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T09:17:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: enabled 2021-01-27T09:17:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active ntp.service 2021-01-27T09:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: active 2021-01-27T09:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:Unit ntp.service is enabled and running 2021-01-27T09:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:Repeating the final host check... 2021-01-27T09:17:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:podman|docker (/usr/bin/docker) is present 2021-01-27T09:17:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl is present 2021-01-27T09:17:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:lvcreate is present 2021-01-27T09:17:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T09:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-27T09:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active chrony.service 2021-01-27T09:17:26.142 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.142 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T09:17:26.148 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-27T09:17:26.149 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T09:17:26.154 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.155 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T09:17:26.162 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: masked 2021-01-27T09:17:26.163 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T09:17:26.169 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.170 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T09:17:26.178 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-27T09:17:26.178 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T09:17:26.184 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: inactive 2021-01-27T09:17:26.185 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T09:17:26.192 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: enabled 2021-01-27T09:17:26.193 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl is-active ntp.service 2021-01-27T09:17:26.200 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: active 2021-01-27T09:17:26.201 INFO:teuthology.orchestra.run.smithi103.stderr:Unit ntp.service is enabled and running 2021-01-27T09:17:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:Host looks OK 2021-01-27T09:17:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:Cluster fsid: 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:Acquiring lock 139856204062528 on /run/cephadm/78337516-6080-11eb-8f9a-001a4aab830c.lock 2021-01-27T09:17:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:Lock 139856204062528 acquired on /run/cephadm/78337516-6080-11eb-8f9a-001a4aab830c.lock 2021-01-27T09:17:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying IP 172.21.15.103 port 3300 ... 2021-01-27T09:17:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying IP 172.21.15.103 port 6789 ... 2021-01-27T09:17:26.204 INFO:teuthology.orchestra.run.smithi103.stderr:Base mon IP is 172.21.15.103, final addrv is [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2021-01-27T09:17:26.204 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/sbin/ip route ls 2021-01-27T09:17:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 2021-01-27T09:17:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.103 metric 100 2021-01-27T09:17:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-01-27T09:17:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.103 2021-01-27T09:17:26.207 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.103 metric 100 2021-01-27T09:17:26.208 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/sbin/ip -6 route ls 2021-01-27T09:17:26.210 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-01-27T09:17:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-01-27T09:17:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1797sec pref medium 2021-01-27T09:17:26.211 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-01-27T09:17:26.215 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-01-27T09:17:26.216 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2021-01-27T09:17:26.216 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-27T09:17:26.216 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-01-27T09:17:26.216 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2021-01-27T09:17:26.217 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-27T09:17:26.217 INFO:teuthology.orchestra.run.smithi103.stderr:Mon IP 172.21.15.103 is in CIDR network 172.21.0.0/20 2021-01-27T09:17:26.218 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096... 2021-01-27T09:17:26.218 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:27.180 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 507028cb839c25d6666833702df6325fd8569096: Pulling from ceph-ci/ceph 2021-01-27T09:17:27.180 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 889524391d55: Pulling fs layer 2021-01-27T09:17:27.181 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 4c303d906d85: Pulling fs layer 2021-01-27T09:17:27.864 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 889524391d55: Verifying Checksum 2021-01-27T09:17:27.864 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 889524391d55: Download complete 2021-01-27T09:17:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 4c303d906d85: Verifying Checksum 2021-01-27T09:17:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 4c303d906d85: Download complete 2021-01-27T09:17:30.319 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 889524391d55: Pull complete 2021-01-27T09:17:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: 4c303d906d85: Pull complete 2021-01-27T09:17:40.104 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: Digest: sha256:c489442ef6855dff2d8ef5c2bf059a3e3799787d2dd370f561e71fe7fd43e3ef 2021-01-27T09:17:40.154 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: Status: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:40.155 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/docker: quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:17:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:Extracting ceph user uid/gid from container image... 2021-01-27T09:17:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -c %u %g /var/lib/ceph 2021-01-27T09:17:51.138 INFO:teuthology.orchestra.run.smithi103.stderr:stat: 167 167 2021-01-27T09:17:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:Creating initial keys... 2021-01-27T09:17:51.839 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T09:17:52.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-authtool: AQDALxFgYN17KxAACMcKni3CLZoPYrstFOdxhg== 2021-01-27T09:17:53.303 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T09:17:54.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-authtool: AQDCLxFgVL6pDBAAUeddhCCidHgqfw5I0TQahA== 2021-01-27T09:17:54.798 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T09:17:55.653 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-authtool: AQDDLxFg3RADJxAAhY/TsUKIC659d4VjFKQjwg== 2021-01-27T09:17:56.213 INFO:teuthology.orchestra.run.smithi103.stderr:Creating initial monmap... 2021-01-27T09:17:56.214 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /tmp/ceph-tmpzdcpl_2n:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --create --clobber --fsid 78337516-6080-11eb-8f9a-001a4aab830c --addv a [v2:172.21.15.103:3300,v1:172.21.15.103:6789] /tmp/monmap 2021-01-27T09:17:57.116 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T09:17:57.116 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:57.116 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T09:17:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:monmaptool for a [v2:172.21.15.103:3300,v1:172.21.15.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T09:17:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/monmaptool: set fsid to 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T09:17:57.760 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:17:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:Creating mon... 2021-01-27T09:17:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpuw7ovpjz:/tmp/keyring:z -v /tmp/ceph-tmpzdcpl_2n:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --mkfs -i a --fsid 78337516-6080-11eb-8f9a-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-01-27T09:17:58.656 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.652+0000 7f531ff52700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T09:17:58.656 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.652+0000 7f531ff52700 1 imported monmap: 2021-01-27T09:17:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: epoch 0 2021-01-27T09:17:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: last_changed 2021-01-27T09:17:57.117248+0000 2021-01-27T09:17:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: created 2021-01-27T09:17:57.117248+0000 2021-01-27T09:17:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-01-27T09:17:58.658 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-01-27T09:17:58.658 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2021-01-27T09:17:58.658 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.658 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.652+0000 7f531ff52700 0 /usr/bin/ceph-mon: set fsid to 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:58.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T09:17:58.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T09:17:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T09:17:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: DB SUMMARY 2021-01-27T09:17:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-01-27T09:17:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-01-27T09:17:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T09:17:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.create_if_missing: 1 2021-01-27T09:17:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T09:17:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.env: 0x560d55ea71c0 2021-01-27T09:17:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.fs: Posix File System 2021-01-27T09:17:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.info_log: 0x560d579b0920 2021-01-27T09:17:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T09:17:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.statistics: (nil) 2021-01-27T09:17:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.use_fsync: 0 2021-01-27T09:17:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T09:17:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T09:17:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T09:17:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T09:17:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T09:17:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T09:17:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T09:17:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T09:17:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T09:17:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T09:17:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T09:17:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.db_log_dir: 2021-01-27T09:17:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T09:17:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T09:17:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T09:17:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T09:17:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T09:17:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T09:17:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T09:17:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T09:17:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T09:17:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T09:17:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T09:17:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.write_buffer_manager: 0x560d579771d0 2021-01-27T09:17:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T09:17:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T09:17:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T09:17:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T09:17:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T09:17:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T09:17:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T09:17:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T09:17:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T09:17:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.unordered_write: 0 2021-01-27T09:17:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T09:17:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T09:17:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T09:17:58.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T09:17:58.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.row_cache: None 2021-01-27T09:17:58.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.wal_filter: None 2021-01-27T09:17:58.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T09:17:58.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T09:17:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T09:17:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T09:17:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T09:17:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T09:17:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T09:17:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T09:17:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T09:17:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T09:17:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T09:17:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T09:17:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T09:17:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T09:17:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T09:17:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T09:17:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T09:17:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T09:17:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T09:17:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T09:17:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T09:17:58.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_open_files: -1 2021-01-27T09:17:58.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T09:17:58.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T09:17:58.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T09:17:58.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T09:17:58.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Compression algorithms supported: 2021-01-27T09:17:58.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T09:17:58.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kZSTD supported: 0 2021-01-27T09:17:58.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T09:17:58.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T09:17:58.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T09:17:58.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T09:17:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T09:17:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T09:17:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T09:17:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-01-27T09:17:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-01-27T09:17:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T09:17:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T09:17:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.merge_operator: 2021-01-27T09:17:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_filter: None 2021-01-27T09:17:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T09:17:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T09:17:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T09:17:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560d578c61c8) 2021-01-27T09:17:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-01-27T09:17:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T09:17:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T09:17:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-01-27T09:17:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: index_type: 0 2021-01-27T09:17:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-01-27T09:17:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-01-27T09:17:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-01-27T09:17:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-01-27T09:17:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: checksum: 1 2021-01-27T09:17:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-01-27T09:17:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_cache: 0x560d578fe110 2021-01-27T09:17:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-01-27T09:17:58.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-01-27T09:17:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-01-27T09:17:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-01-27T09:17:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-01-27T09:17:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-01-27T09:17:58.702 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-01-27T09:17:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-01-27T09:17:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-01-27T09:17:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-01-27T09:17:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-01-27T09:17:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-01-27T09:17:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-01-27T09:17:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-01-27T09:17:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-01-27T09:17:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T09:17:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-01-27T09:17:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-01-27T09:17:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-01-27T09:17:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: format_version: 2 2021-01-27T09:17:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-01-27T09:17:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: block_align: 0 2021-01-27T09:17:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T09:17:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T09:17:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression: NoCompression 2021-01-27T09:17:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T09:17:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T09:17:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T09:17:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.num_levels: 7 2021-01-27T09:17:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T09:17:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T09:17:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T09:17:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T09:17:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T09:17:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T09:17:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T09:17:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:17:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T09:17:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T09:17:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T09:17:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T09:17:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T09:17:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:17:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T09:17:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T09:17:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T09:17:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T09:17:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T09:17:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T09:17:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T09:17:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T09:17:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T09:17:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T09:17:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T09:17:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T09:17:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T09:17:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T09:17:58.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T09:17:58.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T09:17:58.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T09:17:58.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T09:17:58.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T09:17:58.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T09:17:58.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T09:17:58.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T09:17:58.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T09:17:58.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T09:17:58.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T09:17:58.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T09:17:58.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T09:17:58.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T09:17:58.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T09:17:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T09:17:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T09:17:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T09:17:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T09:17:58.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T09:17:58.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T09:17:58.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T09:17:58.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T09:17:58.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T09:17:58.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T09:17:58.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T09:17:58.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T09:17:58.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T09:17:58.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T09:17:58.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T09:17:58.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T09:17:58.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.ttl: 2592000 2021-01-27T09:17:58.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.656+0000 7f531ff52700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T09:17:58.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.660+0000 7f531ff52700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T09:17:58.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.660+0000 7f531ff52700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T09:17:58.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.660+0000 7f531ff52700 4 rocksdb: DB pointer 0x560d579bd800 2021-01-27T09:17:58.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.660+0000 7f5308df4700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T09:17:58.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.660+0000 7f5308df4700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T09:17:58.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-01-27T09:17:58.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:17:58.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T09:17:58.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T09:17:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:17:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T09:17:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T09:17:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:17:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:17:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T09:17:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:17:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:17:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:17:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:17:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:17:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:17:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:17:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:17:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:17:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:17:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:17:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:17:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T09:17:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:17:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:17:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:17:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:17:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T09:17:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:17:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:17:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:17:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:17:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:17:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:17:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:17:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:17:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:17:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:17:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:17:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:17:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: 2021-01-27T09:17:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.664+0000 7f531ff52700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-01-27T09:17:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.664+0000 7f531ff52700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-01-27T09:17:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T09:17:58.664+0000 7f531ff52700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-01-27T09:17:59.208 INFO:teuthology.orchestra.run.smithi103.stderr:create mon.a on 2021-01-27T09:17:59.209 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:17:59.215 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl disable ceph.target 2021-01-27T09:17:59.233 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-01-27T09:17:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl enable ceph.target 2021-01-27T09:17:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-01-27T09:17:59.654 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl start ceph.target 2021-01-27T09:17:59.663 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl enable ceph-78337516-6080-11eb-8f9a-001a4aab830c.target 2021-01-27T09:17:59.676 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target. 2021-01-27T09:17:59.676 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target. 2021-01-27T09:17:59.873 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl start ceph-78337516-6080-11eb-8f9a-001a4aab830c.target 2021-01-27T09:17:59.880 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl daemon-reload 2021-01-27T09:18:00.111 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl stop ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T09:18:00.123 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl reset-failed ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T09:18:00.128 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to reset failed state of unit ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a.service: Unit ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a.service not loaded. 2021-01-27T09:18:00.129 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl enable ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T09:18:00.135 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Created symlink /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target.wants/ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c@.service. 2021-01-27T09:18:00.348 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl start ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T09:18:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:firewalld does not appear to be present 2021-01-27T09:18:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T09:18:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T09:18:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mon to start... 2021-01-27T09:18:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mon... 2021-01-27T09:18:00.366 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status 2021-01-27T09:18:00.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:00 smithi103 systemd[1]: Started Ceph mon.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:18:01.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.708+0000 7fe08b59e700 1 Processor -- start 2021-01-27T09:18:01.712 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.708+0000 7fe08b59e700 1 -- start start 2021-01-27T09:18:01.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.708+0000 7fe08b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:01.713 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.708+0000 7fe08b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c06f900 con 0x7fe08c06f4e0 2021-01-27T09:18:01.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:01.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49054/0 (socket says 172.21.15.103:49054) 2021-01-27T09:18:01.714 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08a59c700 1 -- 172.21.15.103:0/61257150 learned_addr learned my addr 172.21.15.103:0/61257150 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:01.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08a59c700 1 -- 172.21.15.103:0/61257150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c06df70 con 0x7fe08c06f4e0 2021-01-27T09:18:01.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08a59c700 1 --2- 172.21.15.103:0/61257150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe07400b950 tx=0x7fe074006ee0).ready entity=mon.0 client_cookie=bc18e9fb9ef264fa server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:01.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08959a700 1 -- 172.21.15.103:0/61257150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe074009840 con 0x7fe08c06f4e0 2021-01-27T09:18:01.715 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08959a700 1 -- 172.21.15.103:0/61257150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740099a0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.716 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08959a700 1 -- 172.21.15.103:0/61257150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe074009c50 con 0x7fe08c06f4e0 2021-01-27T09:18:01.717 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 -- 172.21.15.103:0/61257150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 msgr2=0x7fe08c06da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:01.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 --2- 172.21.15.103:0/61257150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe07400b950 tx=0x7fe074006ee0).stop 2021-01-27T09:18:01.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 -- 172.21.15.103:0/61257150 shutdown_connections 2021-01-27T09:18:01.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 --2- 172.21.15.103:0/61257150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c06da80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:01.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 -- 172.21.15.103:0/61257150 >> 172.21.15.103:0/61257150 conn(0x7fe08c0f4a40 msgr2=0x7fe08c0f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:01.718 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 -- 172.21.15.103:0/61257150 shutdown_connections 2021-01-27T09:18:01.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 -- 172.21.15.103:0/61257150 wait complete. 2021-01-27T09:18:01.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.712+0000 7fe08b59e700 1 Processor -- start 2021-01-27T09:18:01.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08b59e700 1 -- start start 2021-01-27T09:18:01.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:01.719 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c109920 con 0x7fe08c06f4e0 2021-01-27T09:18:01.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:01.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49056/0 (socket says 172.21.15.103:49056) 2021-01-27T09:18:01.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08a59c700 1 -- 172.21.15.103:0/2257625588 learned_addr learned my addr 172.21.15.103:0/2257625588 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:01.720 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08a59c700 1 -- 172.21.15.103:0/2257625588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c109a60 con 0x7fe08c06f4e0 2021-01-27T09:18:01.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08a59c700 1 --2- 172.21.15.103:0/2257625588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fe074006c70 tx=0x7fe074016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:01.721 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe074009840 con 0x7fe08c06f4e0 2021-01-27T09:18:01.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07401c5a0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c109cb0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07401c870 con 0x7fe08c06f4e0 2021-01-27T09:18:01.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c10a810 con 0x7fe08c06f4e0 2021-01-27T09:18:01.722 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fe07400f070 con 0x7fe08c06f4e0 2021-01-27T09:18:01.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.716+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe074027ac0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.720+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c0581f0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.723 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.720+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fe074016070 con 0x7fe08c06f4e0 2021-01-27T09:18:01.857 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe08c06e2e0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.863 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe082ffd700 1 -- 172.21.15.103:0/2257625588 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+316 (secure 0 0 0) 0x7fe074027da0 con 0x7fe08c06f4e0 2021-01-27T09:18:01.863 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: cluster: 2021-01-27T09:18:01.864 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: id: 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:01.864 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-01-27T09:18:01.865 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.865 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: services: 2021-01-27T09:18:01.866 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.27208s) 2021-01-27T09:18:01.866 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mgr: no daemons active 2021-01-27T09:18:01.867 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-01-27T09:18:01.867 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: data: 2021-01-27T09:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-01-27T09:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-01-27T09:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-01-27T09:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: pgs: 2021-01-27T09:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 msgr2=0x7fe08c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 --2- 172.21.15.103:0/2257625588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fe074006c70 tx=0x7fe074016000).stop 2021-01-27T09:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 shutdown_connections 2021-01-27T09:18:01.872 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 --2- 172.21.15.103:0/2257625588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08c06f4e0 0x7fe08c109430 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:01.872 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 >> 172.21.15.103:0/2257625588 conn(0x7fe08c0f4a40 msgr2=0x7fe08c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:01.873 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 shutdown_connections 2021-01-27T09:18:01.873 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:01.856+0000 7fe08b59e700 1 -- 172.21.15.103:0/2257625588 wait complete. 2021-01-27T09:18:01.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:01 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.588309+0000 mon.a (mon.0) 0 : [INF] mkfs 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:01.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:01 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.582516+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T09:18:02.518 INFO:teuthology.orchestra.run.smithi103.stderr:mon is available 2021-01-27T09:18:02.518 INFO:teuthology.orchestra.run.smithi103.stderr:Assimilating anything we can from ceph.conf... 2021-01-27T09:18:02.519 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-01-27T09:18:02.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.586932+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T09:18:02.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.587246+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} 2021-01-27T09:18:02.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.589854+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-01-27T09:18:02.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.593911+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T09:18:02.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: cluster 2021-01-27T09:18:01.594514+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T09:18:02.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:02 smithi103 bash[9394]: audit 2021-01-27T09:18:01.858979+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.103:0/2257625588' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-01-27T09:18:03.601 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 Processor -- start 2021-01-27T09:18:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 -- start start 2021-01-27T09:18:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80fd3d0 con 0x7fceb80fcac0 2021-01-27T09:18:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebd2eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:03.602 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebd2eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49058/0 (socket says 172.21.15.103:49058) 2021-01-27T09:18:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebd2eb700 1 -- 172.21.15.103:0/2110458382 learned_addr learned my addr 172.21.15.103:0/2110458382 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:03.603 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebd2eb700 1 -- 172.21.15.103:0/2110458382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80fd510 con 0x7fceb80fcac0 2021-01-27T09:18:03.604 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebd2eb700 1 --2- 172.21.15.103:0/2110458382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fceb4009cc0 tx=0x7fceb40092d0).ready entity=mon.0 client_cookie=ccd8ee25b89569f3 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:03.604 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fceaffff700 1 -- 172.21.15.103:0/2110458382 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceb400bbf0 con 0x7fceb80fcac0 2021-01-27T09:18:03.604 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fceaffff700 1 -- 172.21.15.103:0/2110458382 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb400bd50 con 0x7fceb80fcac0 2021-01-27T09:18:03.604 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fceaffff700 1 -- 172.21.15.103:0/2110458382 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceb4011400 con 0x7fceb80fcac0 2021-01-27T09:18:03.605 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 -- 172.21.15.103:0/2110458382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 msgr2=0x7fceb80fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:03.605 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.600+0000 7fcebe2ed700 1 --2- 172.21.15.103:0/2110458382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fceb4009cc0 tx=0x7fceb40092d0).stop 2021-01-27T09:18:03.605 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- 172.21.15.103:0/2110458382 shutdown_connections 2021-01-27T09:18:03.605 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 --2- 172.21.15.103:0/2110458382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb80fcee0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:03.606 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- 172.21.15.103:0/2110458382 >> 172.21.15.103:0/2110458382 conn(0x7fceb806ea50 msgr2=0x7fceb806ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:03.606 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- 172.21.15.103:0/2110458382 shutdown_connections 2021-01-27T09:18:03.606 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- 172.21.15.103:0/2110458382 wait complete. 2021-01-27T09:18:03.607 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 Processor -- start 2021-01-27T09:18:03.608 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- start start 2021-01-27T09:18:03.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:03.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81099c0 con 0x7fceb80fcac0 2021-01-27T09:18:03.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebd2eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:03.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebd2eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49060/0 (socket says 172.21.15.103:49060) 2021-01-27T09:18:03.610 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebd2eb700 1 -- 172.21.15.103:0/3835324291 learned_addr learned my addr 172.21.15.103:0/3835324291 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:03.610 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebd2eb700 1 -- 172.21.15.103:0/3835324291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8109b00 con 0x7fceb80fcac0 2021-01-27T09:18:03.610 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebd2eb700 1 --2- 172.21.15.103:0/3835324291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fceb4000f80 tx=0x7fceb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:03.610 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceb400bec0 con 0x7fceb80fcac0 2021-01-27T09:18:03.610 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb4011400 con 0x7fceb80fcac0 2021-01-27T09:18:03.611 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceb4010ac0 con 0x7fceb80fcac0 2021-01-27T09:18:03.611 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.604+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8109d50 con 0x7fceb80fcac0 2021-01-27T09:18:03.612 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.608+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb810a8b0 con 0x7fceb80fcac0 2021-01-27T09:18:03.612 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.608+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fceb4022030 con 0x7fceb80fcac0 2021-01-27T09:18:03.612 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.608+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fceb40259e0 con 0x7fceb80fcac0 2021-01-27T09:18:03.612 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.608+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80581f0 con 0x7fceb80fcac0 2021-01-27T09:18:03.613 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.612+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fceb4020070 con 0x7fceb80fcac0 2021-01-27T09:18:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.736+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fceb8027100 con 0x7fceb80fcac0 2021-01-27T09:18:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.740+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 7 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fceb4025510 con 0x7fceb80fcac0 2021-01-27T09:18:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.740+0000 7fceadffb700 1 -- 172.21.15.103:0/3835324291 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+340 (secure 0 0 0) 0x7fceb402ee50 con 0x7fceb80fcac0 2021-01-27T09:18:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: [global] 2021-01-27T09:18:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: fsid = 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2021-01-27T09:18:03.746 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-01-27T09:18:03.746 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-01-27T09:18:03.747 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-01-27T09:18:03.748 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-01-27T09:18:03.748 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.748 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: [mgr] 2021-01-27T09:18:03.749 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-01-27T09:18:03.749 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.749 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: [osd] 2021-01-27T09:18:03.749 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-01-27T09:18:03.750 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-01-27T09:18:03.750 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 msgr2=0x7fceb81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 --2- 172.21.15.103:0/3835324291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fceb4000f80 tx=0x7fceb4017000).stop 2021-01-27T09:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 shutdown_connections 2021-01-27T09:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 --2- 172.21.15.103:0/3835324291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fceb80fcac0 0x7fceb81094d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 >> 172.21.15.103:0/3835324291 conn(0x7fceb806ea50 msgr2=0x7fceb80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 shutdown_connections 2021-01-27T09:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:03.744+0000 7fcebe2ed700 1 -- 172.21.15.103:0/3835324291 wait complete. 2021-01-27T09:18:04.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:03 smithi103 bash[9394]: audit 2021-01-27T09:18:03.741804+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.103:0/3835324291' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-01-27T09:18:04.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:03 smithi103 bash[9394]: audit 2021-01-27T09:18:03.745474+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.103:0/3835324291' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-01-27T09:18:04.308 INFO:teuthology.orchestra.run.smithi103.stderr:Generating new minimal ceph.conf... 2021-01-27T09:18:04.308 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-01-27T09:18:05.389 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 Processor -- start 2021-01-27T09:18:05.390 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 -- start start 2021-01-27T09:18:05.390 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:05.390 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380f9c30 con 0x7f3e3806d4b0 2021-01-27T09:18:05.390 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3ccaf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:05.391 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3ccaf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49062/0 (socket says 172.21.15.103:49062) 2021-01-27T09:18:05.392 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3ccaf700 1 -- 172.21.15.103:0/3839075958 learned_addr learned my addr 172.21.15.103:0/3839075958 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:05.392 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3ccaf700 1 -- 172.21.15.103:0/3839075958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380fe730 con 0x7f3e3806d4b0 2021-01-27T09:18:05.392 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3ccaf700 1 --2- 172.21.15.103:0/3839075958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3e2c00b950 tx=0x7f3e2c006ee0).ready entity=mon.0 client_cookie=f68ea9b046162d90 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:05.392 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e377fe700 1 -- 172.21.15.103:0/3839075958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e2c009840 con 0x7f3e3806d4b0 2021-01-27T09:18:05.392 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e377fe700 1 -- 172.21.15.103:0/3839075958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3e2c009e00 con 0x7f3e3806d4b0 2021-01-27T09:18:05.393 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e377fe700 1 -- 172.21.15.103:0/3839075958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e2c011c80 con 0x7f3e3806d4b0 2021-01-27T09:18:05.393 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/3839075958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 msgr2=0x7f3e380fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:05.394 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 --2- 172.21.15.103:0/3839075958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3e2c00b950 tx=0x7f3e2c006ee0).stop 2021-01-27T09:18:05.394 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/3839075958 shutdown_connections 2021-01-27T09:18:05.394 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 --2- 172.21.15.103:0/3839075958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e380fe240 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:05.395 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.388+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/3839075958 >> 172.21.15.103:0/3839075958 conn(0x7f3e380f3940 msgr2=0x7f3e380f5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:05.395 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/3839075958 shutdown_connections 2021-01-27T09:18:05.395 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/3839075958 wait complete. 2021-01-27T09:18:05.395 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 Processor -- start 2021-01-27T09:18:05.396 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- start start 2021-01-27T09:18:05.396 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:05.396 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38109fa0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.397 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3ccaf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3ccaf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49064/0 (socket says 172.21.15.103:49064) 2021-01-27T09:18:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3ccaf700 1 -- 172.21.15.103:0/1427185873 learned_addr learned my addr 172.21.15.103:0/1427185873 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3ccaf700 1 -- 172.21.15.103:0/1427185873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3810a0e0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3ccaf700 1 --2- 172.21.15.103:0/1427185873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3e2c010be0 tx=0x7f3e2c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e2c009ca0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.399 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3810a330 con 0x7f3e3806d4b0 2021-01-27T09:18:05.399 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3e2c011400 con 0x7f3e3806d4b0 2021-01-27T09:18:05.399 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e2c01aba0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.399 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3810ae90 con 0x7f3e3806d4b0 2021-01-27T09:18:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f3e2c00f070 con 0x7f3e3806d4b0 2021-01-27T09:18:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.392+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3e2c01b780 con 0x7f3e3806d4b0 2021-01-27T09:18:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.396+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e380581f0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.400+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f3e2c016070 con 0x7f3e3806d4b0 2021-01-27T09:18:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.524+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3e3810b4f0 con 0x7f3e3806d4b0 2021-01-27T09:18:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.524+0000 7f3e357fa700 1 -- 172.21.15.103:0/1427185873 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f3e2c011700 con 0x7f3e3806d4b0 2021-01-27T09:18:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 msgr2=0x7f3e38109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 --2- 172.21.15.103:0/1427185873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3e2c010be0 tx=0x7f3e2c006ee0).stop 2021-01-27T09:18:05.530 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 shutdown_connections 2021-01-27T09:18:05.530 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 --2- 172.21.15.103:0/1427185873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3806d4b0 0x7f3e38109ab0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:05.531 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 >> 172.21.15.103:0/1427185873 conn(0x7f3e380f3940 msgr2=0x7f3e380f47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:05.531 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 shutdown_connections 2021-01-27T09:18:05.531 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:05.528+0000 7f3e3dcb1700 1 -- 172.21.15.103:0/1427185873 wait complete. 2021-01-27T09:18:05.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:05 smithi103 bash[9394]: audit 2021-01-27T09:18:05.528787+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.103:0/1427185873' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:18:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:Restarting the monitor... 2021-01-27T09:18:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl restart ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T09:18:06.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 systemd[1]: Stopping Ceph mon.a for 78337516-6080-11eb-8f9a-001a4aab830c... 2021-01-27T09:18:06.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 bash[9394]: debug 2021-01-27T09:18:06.208+0000 7f43e36e2700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-01-27T09:18:06.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 bash[9394]: debug 2021-01-27T09:18:06.208+0000 7f43e36e2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-01-27T09:18:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:Setting mon public_network... 2021-01-27T09:18:06.998 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mon public_network 172.21.0.0/20 2021-01-27T09:18:07.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 docker[9710]: ceph-78337516-6080-11eb-8f9a-001a4aab830c-mon.a 2021-01-27T09:18:07.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 systemd[1]: ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.a.service: Succeeded. 2021-01-27T09:18:07.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 systemd[1]: Stopped Ceph mon.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:18:07.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:06 smithi103 systemd[1]: Started Ceph mon.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:18:08.287 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.284+0000 7f0ff7fff700 1 Processor -- start 2021-01-27T09:18:08.287 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.284+0000 7f0ff7fff700 1 -- start start 2021-01-27T09:18:08.288 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.284+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:08.289 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.284+0000 7f0ff7fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80fa040 con 0x7f0ff80f96a0 2021-01-27T09:18:08.289 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:08.289 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49066/0 (socket says 172.21.15.103:49066) 2021-01-27T09:18:08.289 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff6ffd700 1 -- 172.21.15.103:0/1674760028 learned_addr learned my addr 172.21.15.103:0/1674760028 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:08.290 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff6ffd700 1 -- 172.21.15.103:0/1674760028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80fa180 con 0x7f0ff80f96a0 2021-01-27T09:18:08.290 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff6ffd700 1 --2- 172.21.15.103:0/1674760028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f0fe800b950 tx=0x7f0fe8006ee0).ready entity=mon.0 client_cookie=168d02ed2d42b9f0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:08.291 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff5ffb700 1 -- 172.21.15.103:0/1674760028 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8009840 con 0x7f0ff80f96a0 2021-01-27T09:18:08.291 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff5ffb700 1 -- 172.21.15.103:0/1674760028 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0fe8009e00 con 0x7f0ff80f96a0 2021-01-27T09:18:08.291 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff5ffb700 1 -- 172.21.15.103:0/1674760028 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8011c80 con 0x7f0ff80f96a0 2021-01-27T09:18:08.292 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 -- 172.21.15.103:0/1674760028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 msgr2=0x7f0ff80f9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:08.292 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 --2- 172.21.15.103:0/1674760028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f0fe800b950 tx=0x7f0fe8006ee0).stop 2021-01-27T09:18:08.292 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 -- 172.21.15.103:0/1674760028 shutdown_connections 2021-01-27T09:18:08.293 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 --2- 172.21.15.103:0/1674760028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff80f9ac0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:08.293 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 -- 172.21.15.103:0/1674760028 >> 172.21.15.103:0/1674760028 conn(0x7f0ff80f2fd0 msgr2=0x7f0ff80f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:08.293 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 -- 172.21.15.103:0/1674760028 shutdown_connections 2021-01-27T09:18:08.293 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.288+0000 7f0ff7fff700 1 -- 172.21.15.103:0/1674760028 wait complete. 2021-01-27T09:18:08.296 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 Processor -- start 2021-01-27T09:18:08.296 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 -- start start 2021-01-27T09:18:08.296 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:08.297 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8107da0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.297 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:08.297 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49068/0 (socket says 172.21.15.103:49068) 2021-01-27T09:18:08.297 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff6ffd700 1 -- 172.21.15.103:0/2119879572 learned_addr learned my addr 172.21.15.103:0/2119879572 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:08.297 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff6ffd700 1 -- 172.21.15.103:0/2119879572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8107ee0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.298 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff6ffd700 1 --2- 172.21.15.103:0/2119879572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0fe8009fd0 tx=0x7f0fe8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:08.298 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8009ca0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.298 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8108130 con 0x7f0ff80f96a0 2021-01-27T09:18:08.298 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0fe8011400 con 0x7f0ff80f96a0 2021-01-27T09:18:08.298 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8108c90 con 0x7f0ff80f96a0 2021-01-27T09:18:08.299 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe801bc00 con 0x7f0ff80f96a0 2021-01-27T09:18:08.299 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f0fe802b070 con 0x7f0ff80f96a0 2021-01-27T09:18:08.299 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.292+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0fe80233b0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.300 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.296+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80581f0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.301 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.300+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f0fe801f020 con 0x7f0ff80f96a0 2021-01-27T09:18:08.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.172+0000 7f73a6eaa700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T09:18:08.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.172+0000 7f73a6eaa700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T09:18:08.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.172+0000 7f73a6eaa700 0 pidfile_write: ignore empty --pid-file 2021-01-27T09:18:08.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 0 load: jerasure load: lrc load: isa 2021-01-27T09:18:08.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T09:18:08.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T09:18:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T09:18:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: DB SUMMARY 2021-01-27T09:18:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T09:18:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T09:18:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-01-27T09:18:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-01-27T09:18:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 71803 ; 2021-01-27T09:18:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T09:18:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T09:18:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T09:18:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.env: 0x55a4397f01c0 2021-01-27T09:18:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.fs: Posix File System 2021-01-27T09:18:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.info_log: 0x55a43bb03e80 2021-01-27T09:18:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T09:18:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.statistics: (nil) 2021-01-27T09:18:08.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.use_fsync: 0 2021-01-27T09:18:08.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T09:18:08.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T09:18:08.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T09:18:08.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T09:18:08.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T09:18:08.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T09:18:08.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T09:18:08.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T09:18:08.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T09:18:08.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T09:18:08.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T09:18:08.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.db_log_dir: 2021-01-27T09:18:08.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T09:18:08.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T09:18:08.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T09:18:08.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T09:18:08.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T09:18:08.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T09:18:08.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T09:18:08.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T09:18:08.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T09:18:08.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T09:18:08.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T09:18:08.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.write_buffer_manager: 0x55a43bb5dbf0 2021-01-27T09:18:08.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T09:18:08.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T09:18:08.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T09:18:08.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T09:18:08.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T09:18:08.407 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T09:18:08.407 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T09:18:08.407 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T09:18:08.407 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T09:18:08.407 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.unordered_write: 0 2021-01-27T09:18:08.408 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T09:18:08.408 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T09:18:08.408 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T09:18:08.408 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T09:18:08.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.row_cache: None 2021-01-27T09:18:08.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.wal_filter: None 2021-01-27T09:18:08.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T09:18:08.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T09:18:08.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T09:18:08.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T09:18:08.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T09:18:08.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T09:18:08.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T09:18:08.411 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T09:18:08.412 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T09:18:08.412 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T09:18:08.412 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T09:18:08.412 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T09:18:08.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T09:18:08.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T09:18:08.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T09:18:08.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T09:18:08.413 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T09:18:08.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_open_files: -1 2021-01-27T09:18:08.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T09:18:08.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T09:18:08.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T09:18:08.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T09:18:08.415 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Compression algorithms supported: 2021-01-27T09:18:08.415 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T09:18:08.415 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kZSTD supported: 0 2021-01-27T09:18:08.415 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T09:18:08.415 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T09:18:08.416 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T09:18:08.416 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T09:18:08.416 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T09:18:08.416 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T09:18:08.416 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T09:18:08.417 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-01-27T09:18:08.417 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T09:18:08.417 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T09:18:08.417 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.merge_operator: 2021-01-27T09:18:08.417 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_filter: None 2021-01-27T09:18:08.418 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T09:18:08.418 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T09:18:08.418 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T09:18:08.419 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a43baac1e0) 2021-01-27T09:18:08.419 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cache_index_and_filter_blocks: 1 2021-01-27T09:18:08.419 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T09:18:08.419 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T09:18:08.419 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: pin_top_level_index_and_filter: 1 2021-01-27T09:18:08.420 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: index_type: 0 2021-01-27T09:18:08.420 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: data_block_index_type: 0 2021-01-27T09:18:08.420 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: index_shortening: 1 2021-01-27T09:18:08.420 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T09:18:08.420 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: hash_index_allow_collision: 1 2021-01-27T09:18:08.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: checksum: 1 2021-01-27T09:18:08.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: no_block_cache: 0 2021-01-27T09:18:08.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_cache: 0x55a43bae4510 2021-01-27T09:18:08.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_cache_name: BinnedLRUCache 2021-01-27T09:18:08.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_cache_options: 2021-01-27T09:18:08.422 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: capacity : 536870912 2021-01-27T09:18:08.422 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: num_shard_bits : 4 2021-01-27T09:18:08.422 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: strict_capacity_limit : 0 2021-01-27T09:18:08.422 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: high_pri_pool_ratio: 0.000 2021-01-27T09:18:08.422 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_cache_compressed: (nil) 2021-01-27T09:18:08.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: persistent_cache: (nil) 2021-01-27T09:18:08.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_size: 4096 2021-01-27T09:18:08.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_size_deviation: 10 2021-01-27T09:18:08.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_restart_interval: 16 2021-01-27T09:18:08.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: index_block_restart_interval: 1 2021-01-27T09:18:08.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: metadata_block_size: 4096 2021-01-27T09:18:08.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: partition_filters: 0 2021-01-27T09:18:08.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: use_delta_encoding: 1 2021-01-27T09:18:08.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T09:18:08.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: whole_key_filtering: 1 2021-01-27T09:18:08.425 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: verify_compression: 0 2021-01-27T09:18:08.425 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: read_amp_bytes_per_bit: 0 2021-01-27T09:18:08.425 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: format_version: 2 2021-01-27T09:18:08.425 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: enable_index_compression: 1 2021-01-27T09:18:08.425 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: block_align: 0 2021-01-27T09:18:08.426 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T09:18:08.426 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T09:18:08.426 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression: NoCompression 2021-01-27T09:18:08.426 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T09:18:08.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T09:18:08.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T09:18:08.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.num_levels: 7 2021-01-27T09:18:08.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T09:18:08.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T09:18:08.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T09:18:08.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T09:18:08.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T09:18:08.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T09:18:08.429 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T09:18:08.429 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:18:08.429 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T09:18:08.429 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T09:18:08.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T09:18:08.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T09:18:08.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T09:18:08.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:18:08.430 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T09:18:08.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T09:18:08.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T09:18:08.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T09:18:08.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T09:18:08.431 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T09:18:08.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T09:18:08.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T09:18:08.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T09:18:08.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T09:18:08.432 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T09:18:08.433 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T09:18:08.433 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T09:18:08.433 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T09:18:08.433 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T09:18:08.433 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T09:18:08.434 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T09:18:08.434 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T09:18:08.434 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T09:18:08.435 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T09:18:08.435 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T09:18:08.435 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T09:18:08.435 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T09:18:08.435 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T09:18:08.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T09:18:08.437 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T09:18:08.437 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T09:18:08.437 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T09:18:08.437 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T09:18:08.437 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T09:18:08.438 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T09:18:08.438 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T09:18:08.438 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T09:18:08.438 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T09:18:08.438 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T09:18:08.439 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T09:18:08.439 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T09:18:08.439 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T09:18:08.439 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T09:18:08.439 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T09:18:08.440 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.ttl: 2592000 2021-01-27T09:18:08.440 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.176+0000 7f73a6eaa700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T09:18:08.440 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T09:18:08.440 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-01-27T09:18:08.440 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739088182444, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-01-27T09:18:08.441 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-01-27T09:18:08.441 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T09:18:08.441 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739088184615, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 68488, "table_properties": {"data_size": 66781, "index_size": 312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9348, "raw_average_key_size": 46, "raw_value_size": 61473, "raw_average_value_size": 308, "num_data_blocks": 10, "num_entries": 199, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611739088, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T09:18:08.441 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-01-27T09:18:08.441 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.180+0000 7f73a6eaa700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739088185462, "job": 1, "event": "recovery_finished"} 2021-01-27T09:18:08.442 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.184+0000 7f73a6eaa700 4 rocksdb: DB pointer 0x55a43bba3800 2021-01-27T09:18:08.442 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.184+0000 7f73a6eaa700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:08.442 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.184+0000 7f738dccb700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T09:18:08.442 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.184+0000 7f738dccb700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T09:18:08.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** DB Stats ** 2021-01-27T09:18:08.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:18:08.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T09:18:08.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T09:18:08.444 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:18:08.444 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T09:18:08.444 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T09:18:08.444 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:18:08.444 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** Compaction Stats [default] ** 2021-01-27T09:18:08.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:18:08.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:18:08.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: L0 2/0 68.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Sum 2/0 68.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** Compaction Stats [default] ** 2021-01-27T09:18:08.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:18:08.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:18:08.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:18:08.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:18:08.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:18:08.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:18:08.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:18:08.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:18:08.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Cumulative compaction: 0.00 GB write, 10.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:18:08.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Interval compaction: 0.00 GB write, 10.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:18:08.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:18:08.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:18:08.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** Compaction Stats [default] ** 2021-01-27T09:18:08.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:18:08.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:18:08.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: L0 2/0 68.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Sum 2/0 68.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:18:08.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** Compaction Stats [default] ** 2021-01-27T09:18:08.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:18:08.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:18:08.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.5 0.00 0.00 1 0.001 0 0 2021-01-27T09:18:08.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:18:08.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:18:08.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:18:08.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:18:08.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:18:08.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:18:08.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Cumulative compaction: 0.00 GB write, 10.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:18:08.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:18:08.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:18:08.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:18:08.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.184+0000 7f73a6eaa700 1 mon.a@-1(???) e1 preinit fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:08.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).mds e1 new map 2021-01-27T09:18:08.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).mds e1 print_map 2021-01-27T09:18:08.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: e1 2021-01-27T09:18:08.454 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T09:18:08.454 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T09:18:08.454 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: legacy client fscid: -1 2021-01-27T09:18:08.454 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: 2021-01-27T09:18:08.454 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: No filesystems configured 2021-01-27T09:18:08.455 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-01-27T09:18:08.455 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T09:18:08.455 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T09:18:08.455 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T09:18:08.455 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: audit 2021-01-27T09:18:05.528787+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.103:0/1427185873' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:18:08.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-01-27T09:18:08.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expand map: {default=false} 2021-01-27T09:18:08.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T09:18:08.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T09:18:08.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expand map: {default=info} 2021-01-27T09:18:08.457 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T09:18:08.457 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T09:18:08.457 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T09:18:08.457 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T09:18:08.457 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T09:18:08.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T09:18:08.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T09:18:08.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: debug 2021-01-27T09:18:08.188+0000 7f73a6eaa700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T09:18:08.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cluster 2021-01-27T09:18:08.196246+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T09:18:08.459 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cluster 2021-01-27T09:18:08.196335+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} 2021-01-27T09:18:08.459 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cluster 2021-01-27T09:18:08.196416+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-01-27T09:18:08.459 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cluster 2021-01-27T09:18:08.196467+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T09:18:08.459 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:08 smithi103 bash[9772]: cluster 2021-01-27T09:18:08.197007+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T09:18:08.461 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.420+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0ff8044bc0 con 0x7f0ff80f96a0 2021-01-27T09:18:08.461 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.424+0000 7f0fdf7fe700 1 -- 172.21.15.103:0/2119879572 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0fe8016070 con 0x7f0ff80f96a0 2021-01-27T09:18:08.461 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 msgr2=0x7f0ff81078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:08.461 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 --2- 172.21.15.103:0/2119879572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0fe8009fd0 tx=0x7f0fe8006ee0).stop 2021-01-27T09:18:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 shutdown_connections 2021-01-27T09:18:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 --2- 172.21.15.103:0/2119879572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff80f96a0 0x7f0ff81078b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 >> 172.21.15.103:0/2119879572 conn(0x7f0ff80f2fd0 msgr2=0x7f0ff80f3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 shutdown_connections 2021-01-27T09:18:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:08.428+0000 7f0ff7fff700 1 -- 172.21.15.103:0/2119879572 wait complete. 2021-01-27T09:18:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:Wrote config to /etc/ceph/ceph.conf 2021-01-27T09:18:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-01-27T09:18:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:Creating mgr... 2021-01-27T09:18:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:Verifying port 9283 ... 2021-01-27T09:18:09.105 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl daemon-reload 2021-01-27T09:18:09.326 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl stop ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T09:18:09.338 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl reset-failed ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T09:18:09.343 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Failed to reset failed state of unit ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y.service: Unit ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y.service not loaded. 2021-01-27T09:18:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl enable ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T09:18:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:systemctl: Created symlink /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c.target.wants/ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-78337516-6080-11eb-8f9a-001a4aab830c@.service. 2021-01-27T09:18:09.585 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: systemctl start ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T09:18:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:firewalld does not appear to be present 2021-01-27T09:18:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T09:18:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T09:18:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:firewalld does not appear to be present 2021-01-27T09:18:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-01-27T09:18:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mgr to start... 2021-01-27T09:18:09.598 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mgr... 2021-01-27T09:18:09.598 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T09:18:09.776 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:09 smithi103 bash[9772]: audit 2021-01-27T09:18:08.428866+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.103:0/2119879572' entity='client.admin' 2021-01-27T09:18:09.777 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:09 smithi103 systemd[1]: Started Ceph mgr.y for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:18:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.036+0000 7f8686fb7700 1 Processor -- start 2021-01-27T09:18:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.036+0000 7f8686fb7700 1 -- start start 2021-01-27T09:18:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.036+0000 7f8686fb7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.036+0000 7f8686fb7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868006e000 con 0x7f868006f640 2021-01-27T09:18:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49074/0 (socket says 172.21.15.103:49074) 2021-01-27T09:18:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 -- 172.21.15.103:0/641340426 learned_addr learned my addr 172.21.15.103:0/641340426 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 -- 172.21.15.103:0/641340426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868006e140 con 0x7f868006f640 2021-01-27T09:18:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 --2- 172.21.15.103:0/641340426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8678009cc0 tx=0x7f86780092d0).ready entity=mon.0 client_cookie=cd1d49e1c7492291 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8684fb3700 1 -- 172.21.15.103:0/641340426 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867800bbf0 con 0x7f868006f640 2021-01-27T09:18:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8684fb3700 1 -- 172.21.15.103:0/641340426 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f867800bd50 con 0x7f868006f640 2021-01-27T09:18:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8684fb3700 1 -- 172.21.15.103:0/641340426 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8678010560 con 0x7f868006f640 2021-01-27T09:18:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- 172.21.15.103:0/641340426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 msgr2=0x7f868006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 --2- 172.21.15.103:0/641340426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8678009cc0 tx=0x7f86780092d0).stop 2021-01-27T09:18:11.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- 172.21.15.103:0/641340426 shutdown_connections 2021-01-27T09:18:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 --2- 172.21.15.103:0/641340426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f868006db10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- 172.21.15.103:0/641340426 >> 172.21.15.103:0/641340426 conn(0x7f86800f4a30 msgr2=0x7f86800f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- 172.21.15.103:0/641340426 shutdown_connections 2021-01-27T09:18:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- 172.21.15.103:0/641340426 wait complete. 2021-01-27T09:18:11.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 Processor -- start 2021-01-27T09:18:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- start start 2021-01-27T09:18:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8686fb7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010a100 con 0x7f868006f640 2021-01-27T09:18:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49076/0 (socket says 172.21.15.103:49076) 2021-01-27T09:18:11.050 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.040+0000 7f8685fb5700 1 -- 172.21.15.103:0/1483477267 learned_addr learned my addr 172.21.15.103:0/1483477267 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:11.050 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f8685fb5700 1 -- 172.21.15.103:0/1483477267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868010a240 con 0x7f868006f640 2021-01-27T09:18:11.050 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f8685fb5700 1 --2- 172.21.15.103:0/1483477267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8678010d50 tx=0x7f86780092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:11.050 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867800bbf0 con 0x7f868006f640 2021-01-27T09:18:11.050 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f867800bec0 con 0x7f868006f640 2021-01-27T09:18:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8678023550 con 0x7f868006f640 2021-01-27T09:18:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868010a490 con 0x7f868006f640 2021-01-27T09:18:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868010aff0 con 0x7f868006f640 2021-01-27T09:18:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f867800f070 con 0x7f868006f640 2021-01-27T09:18:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f867802c8e0 con 0x7f868006f640 2021-01-27T09:18:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.044+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86800581f0 con 0x7f868006f640 2021-01-27T09:18:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.048+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f867801e030 con 0x7f868006f640 2021-01-27T09:18:11.182 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.180+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f86800ff570 con 0x7f868006f640 2021-01-27T09:18:11.184 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.180+0000 7f86767fc700 1 -- 172.21.15.103:0/1483477267 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7f867802caf0 con 0x7f868006f640 2021-01-27T09:18:11.184 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:11.184 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsid": "78337516-6080-11eb-8f9a-001a4aab830c", 2021-01-27T09:18:11.185 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "health": { 2021-01-27T09:18:11.185 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T09:18:11.185 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T09:18:11.185 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T09:18:11.186 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.186 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T09:18:11.186 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T09:18:11.191 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 0 2021-01-27T09:18:11.191 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:11.191 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T09:18:11.191 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "a" 2021-01-27T09:18:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_age": 2, 2021-01-27T09:18:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T09:18:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T09:18:11.193 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T09:18:11.193 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.193 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T09:18:11.194 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:11.194 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T09:18:11.194 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T09:18:11.194 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T09:18:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T09:18:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T09:18:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T09:18:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T09:18:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T09:18:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T09:18:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T09:18:11.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T09:18:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T09:18:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T09:18:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T09:18:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T09:18:11.197 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T09:18:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T09:18:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T09:18:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T09:18:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "available": false, 2021-01-27T09:18:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T09:18:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T09:18:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "iostat", 2021-01-27T09:18:11.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "restful" 2021-01-27T09:18:11.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:11.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:11.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T09:18:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modified": "2021-01-27T09:18:01.588745+0000", 2021-01-27T09:18:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:11.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:11.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T09:18:11.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:11.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 msgr2=0x7f8680109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:11.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 --2- 172.21.15.103:0/1483477267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8678010d50 tx=0x7f86780092d0).stop 2021-01-27T09:18:11.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 shutdown_connections 2021-01-27T09:18:11.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 --2- 172.21.15.103:0/1483477267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868006f640 0x7f8680109c10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:11.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 >> 172.21.15.103:0/1483477267 conn(0x7f86800f4a30 msgr2=0x7f86800f6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:11.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 shutdown_connections 2021-01-27T09:18:11.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:11.184+0000 7f8686fb7700 1 -- 172.21.15.103:0/1483477267 wait complete. 2021-01-27T09:18:11.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:11 smithi103 bash[9772]: audit 2021-01-27T09:18:11.184582+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.103:0/1483477267' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T09:18:11.767 INFO:teuthology.orchestra.run.smithi103.stderr:mgr not available, waiting (1/15)... 2021-01-27T09:18:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T09:18:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482f76f700 1 Processor -- start 2021-01-27T09:18:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482f76f700 1 -- start start 2021-01-27T09:18:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482f76f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482f76f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482806d780 con 0x7f482806d360 2021-01-27T09:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482d50b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482d50b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49078/0 (socket says 172.21.15.103:49078) 2021-01-27T09:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482d50b700 1 -- 172.21.15.103:0/4248440575 learned_addr learned my addr 172.21.15.103:0/4248440575 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482d50b700 1 -- 172.21.15.103:0/4248440575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280fc5e0 con 0x7f482806d360 2021-01-27T09:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f482d50b700 1 --2- 172.21.15.103:0/4248440575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f482400b950 tx=0x7f4824006ee0).ready entity=mon.0 client_cookie=66cc41d5bcbcf9e7 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f4817fff700 1 -- 172.21.15.103:0/4248440575 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4824009840 con 0x7f482806d360 2021-01-27T09:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.836+0000 7f4817fff700 1 -- 172.21.15.103:0/4248440575 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4824009e00 con 0x7f482806d360 2021-01-27T09:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f4817fff700 1 -- 172.21.15.103:0/4248440575 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4824011c80 con 0x7f482806d360 2021-01-27T09:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- 172.21.15.103:0/4248440575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 msgr2=0x7f48280fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 --2- 172.21.15.103:0/4248440575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f482400b950 tx=0x7f4824006ee0).stop 2021-01-27T09:18:14.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- 172.21.15.103:0/4248440575 shutdown_connections 2021-01-27T09:18:14.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 --2- 172.21.15.103:0/4248440575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f48280fc0f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:14.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- 172.21.15.103:0/4248440575 >> 172.21.15.103:0/4248440575 conn(0x7f48280f3ad0 msgr2=0x7f48280f5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:14.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- 172.21.15.103:0/4248440575 shutdown_connections 2021-01-27T09:18:14.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- 172.21.15.103:0/4248440575 wait complete. 2021-01-27T09:18:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 Processor -- start 2021-01-27T09:18:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- start start 2021-01-27T09:18:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:14.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482f76f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4828107f60 con 0x7f482806d360 2021-01-27T09:18:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482d50b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482d50b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49080/0 (socket says 172.21.15.103:49080) 2021-01-27T09:18:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482d50b700 1 -- 172.21.15.103:0/3027183305 learned_addr learned my addr 172.21.15.103:0/3027183305 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:14.847 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482d50b700 1 -- 172.21.15.103:0/3027183305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48281080a0 con 0x7f482806d360 2021-01-27T09:18:14.848 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f482d50b700 1 --2- 172.21.15.103:0/3027183305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4824009420 tx=0x7f4824006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:14.849 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.840+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4824009ca0 con 0x7f482806d360 2021-01-27T09:18:14.849 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4824011400 con 0x7f482806d360 2021-01-27T09:18:14.849 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f482401bbf0 con 0x7f482806d360 2021-01-27T09:18:14.849 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48281082f0 con 0x7f482806d360 2021-01-27T09:18:14.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4828108e50 con 0x7f482806d360 2021-01-27T09:18:14.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f482402b070 con 0x7f482806d360 2021-01-27T09:18:14.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4824023720 con 0x7f482806d360 2021-01-27T09:18:14.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.844+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280581f0 con 0x7f482806d360 2021-01-27T09:18:14.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.848+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f482401f020 con 0x7f482806d360 2021-01-27T09:18:14.977 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.976+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f48280fd470 con 0x7f482806d360 2021-01-27T09:18:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.976+0000 7f4815ffb700 1 -- 172.21.15.103:0/3027183305 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7f4824016070 con 0x7f482806d360 2021-01-27T09:18:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsid": "78337516-6080-11eb-8f9a-001a4aab830c", 2021-01-27T09:18:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "health": { 2021-01-27T09:18:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T09:18:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T09:18:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T09:18:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T09:18:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T09:18:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 0 2021-01-27T09:18:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T09:18:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "a" 2021-01-27T09:18:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_age": 6, 2021-01-27T09:18:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T09:18:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T09:18:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T09:18:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T09:18:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T09:18:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T09:18:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T09:18:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T09:18:14.992 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T09:18:14.992 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T09:18:14.992 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.993 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T09:18:14.993 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T09:18:14.993 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T09:18:14.993 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T09:18:14.993 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T09:18:14.994 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T09:18:14.994 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T09:18:14.994 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T09:18:14.994 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T09:18:14.995 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.995 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T09:18:14.995 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:14.995 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T09:18:14.996 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T09:18:14.996 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.996 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T09:18:14.996 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "available": false, 2021-01-27T09:18:14.997 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T09:18:14.997 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T09:18:14.997 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "iostat", 2021-01-27T09:18:14.997 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "restful" 2021-01-27T09:18:14.997 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T09:18:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:14.999 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modified": "2021-01-27T09:18:01.588745+0000", 2021-01-27T09:18:14.999 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:14.999 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:14.999 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T09:18:14.999 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:15.000 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 msgr2=0x7f4828107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:15.000 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 --2- 172.21.15.103:0/3027183305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4824009420 tx=0x7f4824006ee0).stop 2021-01-27T09:18:15.000 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 shutdown_connections 2021-01-27T09:18:15.000 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 --2- 172.21.15.103:0/3027183305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806d360 0x7f4828107a70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:15.001 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 >> 172.21.15.103:0/3027183305 conn(0x7f48280f3ad0 msgr2=0x7f48280f4910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:15.001 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 shutdown_connections 2021-01-27T09:18:15.001 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:14.980+0000 7f482f76f700 1 -- 172.21.15.103:0/3027183305 wait complete. 2021-01-27T09:18:15.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:15 smithi103 bash[9772]: audit 2021-01-27T09:18:14.979997+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.103:0/3027183305' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T09:18:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:mgr not available, waiting (2/15)... 2021-01-27T09:18:17.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: cluster 2021-01-27T09:18:16.760169+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-01-27T09:18:17.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: cluster 2021-01-27T09:18:16.766558+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00657141s) 2021-01-27T09:18:17.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.768324+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T09:18:17.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.768611+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T09:18:17.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.768837+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T09:18:17.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.770328+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T09:18:17.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.770979+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T09:18:17.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: cluster 2021-01-27T09:18:16.775833+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-01-27T09:18:17.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.792078+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' 2021-01-27T09:18:17.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.798794+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:18:17.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.801249+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:18:17.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:16 smithi103 bash[9772]: audit 2021-01-27T09:18:16.810227+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' 2021-01-27T09:18:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T09:18:18.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:17 smithi103 bash[9772]: audit 2021-01-27T09:18:16.816275+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.103:0/4125280023' entity='mgr.y' 2021-01-27T09:18:18.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:17 smithi103 bash[9772]: cluster 2021-01-27T09:18:17.771459+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01147s) 2021-01-27T09:18:18.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afb59e700 1 Processor -- start 2021-01-27T09:18:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afb59e700 1 -- start start 2021-01-27T09:18:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afb59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afb59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0fd3d0 con 0x7f5afc0fcac0 2021-01-27T09:18:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49100/0 (socket says 172.21.15.103:49100) 2021-01-27T09:18:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afa59c700 1 -- 172.21.15.103:0/1251421574 learned_addr learned my addr 172.21.15.103:0/1251421574 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afa59c700 1 -- 172.21.15.103:0/1251421574 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0fd510 con 0x7f5afc0fcac0 2021-01-27T09:18:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.672+0000 7f5afa59c700 1 --2- 172.21.15.103:0/1251421574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5aec00b950 tx=0x7f5aec006ee0).ready entity=mon.0 client_cookie=1483c0ea59ce19fb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af9d9b700 1 -- 172.21.15.103:0/1251421574 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aec009840 con 0x7f5afc0fcac0 2021-01-27T09:18:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af9d9b700 1 -- 172.21.15.103:0/1251421574 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5aec009e00 con 0x7f5afc0fcac0 2021-01-27T09:18:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af9d9b700 1 -- 172.21.15.103:0/1251421574 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aec011c80 con 0x7f5afc0fcac0 2021-01-27T09:18:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1251421574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 msgr2=0x7f5afc0fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1251421574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5aec00b950 tx=0x7f5aec006ee0).stop 2021-01-27T09:18:18.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1251421574 shutdown_connections 2021-01-27T09:18:18.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1251421574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc0fcac0 0x7f5afc0fcee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:18.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1251421574 >> 172.21.15.103:0/1251421574 conn(0x7f5afc06ea50 msgr2=0x7f5afc06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:18.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1251421574 shutdown_connections 2021-01-27T09:18:18.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1251421574 wait complete. 2021-01-27T09:18:18.684 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 Processor -- start 2021-01-27T09:18:18.684 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- start start 2021-01-27T09:18:18.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc10a600 con 0x7f5afc109cd0 2021-01-27T09:18:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49102/0 (socket says 172.21.15.103:49102) 2021-01-27T09:18:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afa59c700 1 -- 172.21.15.103:0/1720599186 learned_addr learned my addr 172.21.15.103:0/1720599186 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afa59c700 1 -- 172.21.15.103:0/1720599186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc10a740 con 0x7f5afc109cd0 2021-01-27T09:18:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afa59c700 1 --2- 172.21.15.103:0/1720599186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5aec013000 tx=0x7f5aec006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aec009ca0 con 0x7f5afc109cd0 2021-01-27T09:18:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc10b030 con 0x7f5afc109cd0 2021-01-27T09:18:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc10b460 con 0x7f5afc109cd0 2021-01-27T09:18:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5aec011ae0 con 0x7f5afc109cd0 2021-01-27T09:18:18.693 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.676+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aec01ba30 con 0x7f5afc109cd0 2021-01-27T09:18:18.693 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 3) v1 ==== 35680+0+0 (secure 0 0 0) 0x7f5aec00f070 con 0x7f5afc109cd0 2021-01-27T09:18:18.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae0004da0 con 0x7f5afc109cd0 2021-01-27T09:18:18.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5af37fe700 1 --2- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 0x7f5adc031f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:18.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5aec041360 con 0x7f5afc109cd0 2021-01-27T09:18:18.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5af1d9b700 1 --2- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 0x7f5adc031f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:18.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.680+0000 7f5af1d9b700 1 --2- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 0x7f5adc031f10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5ae40096a0 tx=0x7f5ae4006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:18.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:18.688+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f5aec018b60 con 0x7f5afc109cd0 2021-01-27T09:18:19.083 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.080+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5ae0005470 con 0x7f5afc109cd0 2021-01-27T09:18:19.083 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.080+0000 7f5af37fe700 1 -- 172.21.15.103:0/1720599186 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7f5aec016070 con 0x7f5afc109cd0 2021-01-27T09:18:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsid": "78337516-6080-11eb-8f9a-001a4aab830c", 2021-01-27T09:18:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "health": { 2021-01-27T09:18:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T09:18:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T09:18:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T09:18:19.087 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.087 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T09:18:19.087 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T09:18:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 0 2021-01-27T09:18:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T09:18:19.089 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "a" 2021-01-27T09:18:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "quorum_age": 10, 2021-01-27T09:18:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T09:18:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T09:18:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T09:18:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T09:18:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:19.092 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T09:18:19.096 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T09:18:19.097 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T09:18:19.097 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T09:18:19.097 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T09:18:19.097 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T09:18:19.097 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.098 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T09:18:19.098 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T09:18:19.098 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T09:18:19.098 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T09:18:19.099 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T09:18:19.099 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T09:18:19.099 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T09:18:19.099 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T09:18:19.100 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T09:18:19.100 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.100 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T09:18:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T09:18:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T09:18:19.101 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T09:18:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "available": true, 2021-01-27T09:18:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T09:18:19.102 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T09:18:19.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "iostat", 2021-01-27T09:18:19.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "restful" 2021-01-27T09:18:19.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ], 2021-01-27T09:18:19.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:19.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T09:18:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T09:18:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "modified": "2021-01-27T09:18:01.588745+0000", 2021-01-27T09:18:19.104 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "services": {} 2021-01-27T09:18:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: }, 2021-01-27T09:18:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T09:18:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:19.105 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 msgr2=0x7f5adc031f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 0x7f5adc031f10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5ae40096a0 tx=0x7f5ae4006b40).stop 2021-01-27T09:18:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 msgr2=0x7f5afc10a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1720599186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5aec013000 tx=0x7f5aec006ee0).stop 2021-01-27T09:18:19.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 shutdown_connections 2021-01-27T09:18:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1720599186 >> v2:172.21.15.103:6800/9391381 conn(0x7f5adc02fa50 0x7f5adc031f10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 --2- 172.21.15.103:0/1720599186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5afc109cd0 0x7f5afc10a110 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.084+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 >> 172.21.15.103:0/1720599186 conn(0x7f5afc06ea50 msgr2=0x7f5afc0fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.088+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 shutdown_connections 2021-01-27T09:18:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:19.088+0000 7f5afb59e700 1 -- 172.21.15.103:0/1720599186 wait complete. 2021-01-27T09:18:19.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:19 smithi103 bash[9772]: audit 2021-01-27T09:18:19.085314+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.103:0/1720599186' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T09:18:19.656 INFO:teuthology.orchestra.run.smithi103.stderr:mgr is available 2021-01-27T09:18:19.657 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config-key set mgr/cephadm/ssh_user root 2021-01-27T09:18:20.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:20 smithi103 bash[9772]: cluster 2021-01-27T09:18:19.205754+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-01-27T09:18:20.662 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f1894947700 1 Processor -- start 2021-01-27T09:18:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f1894947700 1 -- start start 2021-01-27T09:18:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f1894947700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f1894947700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189006fa20 con 0x7f189006f600 2021-01-27T09:18:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49106/0 (socket says 172.21.15.103:49106) 2021-01-27T09:18:20.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f188f7fe700 1 -- 172.21.15.103:0/2491409753 learned_addr learned my addr 172.21.15.103:0/2491409753 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:20.665 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f188f7fe700 1 -- 172.21.15.103:0/2491409753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189006dfc0 con 0x7f189006f600 2021-01-27T09:18:20.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.660+0000 7f188f7fe700 1 --2- 172.21.15.103:0/2491409753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f188400b950 tx=0x7f1884006ee0).ready entity=mon.0 client_cookie=84b53cf89a991d00 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:20.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188e7fc700 1 -- 172.21.15.103:0/2491409753 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1884009840 con 0x7f189006f600 2021-01-27T09:18:20.666 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188e7fc700 1 -- 172.21.15.103:0/2491409753 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1884009e00 con 0x7f189006f600 2021-01-27T09:18:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188e7fc700 1 -- 172.21.15.103:0/2491409753 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1884011c80 con 0x7f189006f600 2021-01-27T09:18:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- 172.21.15.103:0/2491409753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 msgr2=0x7f189006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 --2- 172.21.15.103:0/2491409753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f188400b950 tx=0x7f1884006ee0).stop 2021-01-27T09:18:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- 172.21.15.103:0/2491409753 shutdown_connections 2021-01-27T09:18:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 --2- 172.21.15.103:0/2491409753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f189006dad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- 172.21.15.103:0/2491409753 >> 172.21.15.103:0/2491409753 conn(0x7f18900f4a30 msgr2=0x7f18900f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- 172.21.15.103:0/2491409753 shutdown_connections 2021-01-27T09:18:20.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- 172.21.15.103:0/2491409753 wait complete. 2021-01-27T09:18:20.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 Processor -- start 2021-01-27T09:18:20.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- start start 2021-01-27T09:18:20.670 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f1894947700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900f9690 con 0x7f189006f600 2021-01-27T09:18:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49108/0 (socket says 172.21.15.103:49108) 2021-01-27T09:18:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188f7fe700 1 -- 172.21.15.103:0/1817148900 learned_addr learned my addr 172.21.15.103:0/1817148900 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.664+0000 7f188f7fe700 1 -- 172.21.15.103:0/1817148900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900f97d0 con 0x7f189006f600 2021-01-27T09:18:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f188f7fe700 1 --2- 172.21.15.103:0/1817148900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1884009420 tx=0x7f1884006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1884009ca0 con 0x7f189006f600 2021-01-27T09:18:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18900f9a20 con 0x7f189006f600 2021-01-27T09:18:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18900fa5d0 con 0x7f189006f600 2021-01-27T09:18:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1884011ae0 con 0x7f189006f600 2021-01-27T09:18:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188401b9b0 con 0x7f189006f600 2021-01-27T09:18:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 35760+0+0 (secure 0 0 0) 0x7f188400f070 con 0x7f189006f600 2021-01-27T09:18:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 --2- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 0x7f187c031fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f1884040fa0 con 0x7f189006f600 2021-01-27T09:18:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870004da0 con 0x7f189006f600 2021-01-27T09:18:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f188effd700 1 --2- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 0x7f187c031fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.668+0000 7f188effd700 1 --2- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 0x7f187c031fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f18800096a0 tx=0x7f1880006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:20.676+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f1884016020 con 0x7f189006f600 2021-01-27T09:18:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.120+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config-key set, key=mgr/cephadm/ssh_user}] v 0) v1 -- 0x7f18700059f0 con 0x7f189006f600 2021-01-27T09:18:21.122 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.120+0000 7f1877fff700 1 -- 172.21.15.103:0/1817148900 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/cephadm/ssh_user}]=0 set mgr/cephadm/ssh_user v0)=0 set mgr/cephadm/ssh_user v0) v1 ==== 132+0+0 (secure 0 0 0) 0x7f1884011700 con 0x7f189006f600 2021-01-27T09:18:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 msgr2=0x7f187c031fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:21.126 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 --2- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 0x7f187c031fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f18800096a0 tx=0x7f1880006b40).stop 2021-01-27T09:18:21.126 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 msgr2=0x7f18900f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:21.126 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 --2- 172.21.15.103:0/1817148900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1884009420 tx=0x7f1884006ee0).stop 2021-01-27T09:18:21.126 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 shutdown_connections 2021-01-27T09:18:21.126 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 --2- 172.21.15.103:0/1817148900 >> v2:172.21.15.103:6800/9391381 conn(0x7f187c02fae0 0x7f187c031fa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:21.127 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 --2- 172.21.15.103:0/1817148900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f189006f600 0x7f18900f91a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:21.127 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 >> 172.21.15.103:0/1817148900 conn(0x7f18900f4a30 msgr2=0x7f18900f5850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:21.127 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 shutdown_connections 2021-01-27T09:18:21.127 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:21.124+0000 7f1894947700 1 -- 172.21.15.103:0/1817148900 wait complete. 2021-01-27T09:18:21.128 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: set mgr/cephadm/ssh_user 2021-01-27T09:18:21.713 INFO:teuthology.orchestra.run.smithi103.stderr:Enabling cephadm module... 2021-01-27T09:18:21.713 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable cephadm 2021-01-27T09:18:22.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:22 smithi103 bash[9772]: audit 2021-01-27T09:18:21.124929+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.103:0/1817148900' entity='client.admin' 2021-01-27T09:18:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c21eb700 1 Processor -- start 2021-01-27T09:18:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c21eb700 1 -- start start 2021-01-27T09:18:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c21eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c21eb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc06f930 con 0x7f09bc06f510 2021-01-27T09:18:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c11e9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c11e9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49112/0 (socket says 172.21.15.103:49112) 2021-01-27T09:18:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c11e9700 1 -- 172.21.15.103:0/1675662577 learned_addr learned my addr 172.21.15.103:0/1675662577 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c11e9700 1 -- 172.21.15.103:0/1675662577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc06dfa0 con 0x7f09bc06f510 2021-01-27T09:18:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.684+0000 7f09c11e9700 1 --2- 172.21.15.103:0/1675662577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f09b000b950 tx=0x7f09b0006ee0).ready entity=mon.0 client_cookie=c4f17935fed7061d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09bbfff700 1 -- 172.21.15.103:0/1675662577 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09b0009840 con 0x7f09bc06f510 2021-01-27T09:18:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09bbfff700 1 -- 172.21.15.103:0/1675662577 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f09b0009e00 con 0x7f09bc06f510 2021-01-27T09:18:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09bbfff700 1 -- 172.21.15.103:0/1675662577 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09b0011c80 con 0x7f09bc06f510 2021-01-27T09:18:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- 172.21.15.103:0/1675662577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 msgr2=0x7f09bc06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 --2- 172.21.15.103:0/1675662577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f09b000b950 tx=0x7f09b0006ee0).stop 2021-01-27T09:18:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- 172.21.15.103:0/1675662577 shutdown_connections 2021-01-27T09:18:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 --2- 172.21.15.103:0/1675662577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc06dab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- 172.21.15.103:0/1675662577 >> 172.21.15.103:0/1675662577 conn(0x7f09bc0f4a30 msgr2=0x7f09bc0f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- 172.21.15.103:0/1675662577 shutdown_connections 2021-01-27T09:18:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- 172.21.15.103:0/1675662577 wait complete. 2021-01-27T09:18:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 Processor -- start 2021-01-27T09:18:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- start start 2021-01-27T09:18:22.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:22.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c21eb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc109ff0 con 0x7f09bc06f510 2021-01-27T09:18:22.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c11e9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:22.694 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c11e9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49114/0 (socket says 172.21.15.103:49114) 2021-01-27T09:18:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c11e9700 1 -- 172.21.15.103:0/2940969516 learned_addr learned my addr 172.21.15.103:0/2940969516 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.688+0000 7f09c11e9700 1 -- 172.21.15.103:0/2940969516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc10a130 con 0x7f09bc06f510 2021-01-27T09:18:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c11e9700 1 --2- 172.21.15.103:0/2940969516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f09b0009fd0 tx=0x7f09b0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09b0009ca0 con 0x7f09bc06f510 2021-01-27T09:18:22.695 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f09b0011ae0 con 0x7f09bc06f510 2021-01-27T09:18:22.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc10a380 con 0x7f09bc06f510 2021-01-27T09:18:22.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09b001ba70 con 0x7f09bc06f510 2021-01-27T09:18:22.696 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc10aee0 con 0x7f09bc06f510 2021-01-27T09:18:22.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 35760+0+0 (secure 0 0 0) 0x7f09b002b070 con 0x7f09bc06f510 2021-01-27T09:18:22.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc0581f0 con 0x7f09bc06f510 2021-01-27T09:18:22.697 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 --2- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 0x7f09a8032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:22.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f09b00423e0 con 0x7f09bc06f510 2021-01-27T09:18:22.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c09e8700 1 --2- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 0x7f09a8032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:22.698 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.692+0000 7f09c09e8700 1 --2- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 0x7f09a8032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f09b40089e0 tx=0x7f09b4006ec0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:22.701 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:22.700+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f09b0022d50 con 0x7f09bc06f510 2021-01-27T09:18:23.057 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.056+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f09bc044bc0 con 0x7f09bc06f510 2021-01-27T09:18:23.130 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.128+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f09b000f070 con 0x7f09bc06f510 2021-01-27T09:18:23.132 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.132+0000 7f09b9ffb700 1 -- 172.21.15.103:0/2940969516 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f09b002c580 con 0x7f09bc06f510 2021-01-27T09:18:23.137 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 msgr2=0x7f09a8032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:23.137 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 --2- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 0x7f09a8032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f09b40089e0 tx=0x7f09b4006ec0).stop 2021-01-27T09:18:23.138 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 msgr2=0x7f09bc109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:23.138 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 --2- 172.21.15.103:0/2940969516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f09b0009fd0 tx=0x7f09b0006ee0).stop 2021-01-27T09:18:23.138 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 shutdown_connections 2021-01-27T09:18:23.138 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 --2- 172.21.15.103:0/2940969516 >> v2:172.21.15.103:6800/9391381 conn(0x7f09a802fb70 0x7f09a8032030 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:23.138 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 --2- 172.21.15.103:0/2940969516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09bc06f510 0x7f09bc109b00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:23.139 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 >> 172.21.15.103:0/2940969516 conn(0x7f09bc0f4a30 msgr2=0x7f09bc0f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:23.139 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 shutdown_connections 2021-01-27T09:18:23.139 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:23.136+0000 7f09c21eb700 1 -- 172.21.15.103:0/2940969516 wait complete. 2021-01-27T09:18:23.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:23 smithi103 bash[9772]: audit 2021-01-27T09:18:23.060314+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.103:0/2940969516' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-01-27T09:18:23.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:23 smithi103 bash[10018]: ignoring --setuser ceph since I am not root 2021-01-27T09:18:23.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:23 smithi103 bash[10018]: ignoring --setgroup ceph since I am not root 2021-01-27T09:18:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-27T09:18:24.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:24 smithi103 bash[9772]: audit 2021-01-27T09:18:23.134789+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.103:0/2940969516' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-01-27T09:18:24.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:24 smithi103 bash[9772]: cluster 2021-01-27T09:18:23.134971+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 6s) 2021-01-27T09:18:25.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b7bf0700 1 Processor -- start 2021-01-27T09:18:25.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b7bf0700 1 -- start start 2021-01-27T09:18:25.551 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b7bf0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:25.551 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b7bf0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b006f8e0 con 0x7f70b006f4c0 2021-01-27T09:18:25.551 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b598c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:25.551 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b598c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49130/0 (socket says 172.21.15.103:49130) 2021-01-27T09:18:25.552 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b598c700 1 -- 172.21.15.103:0/79945936 learned_addr learned my addr 172.21.15.103:0/79945936 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:25.552 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.536+0000 7f70b598c700 1 -- 172.21.15.103:0/79945936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b006df50 con 0x7f70b006f4c0 2021-01-27T09:18:25.565 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.540+0000 7f70b598c700 1 --2- 172.21.15.103:0/79945936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f70ac009480 tx=0x7f70ac006ee0).ready entity=mon.0 client_cookie=99782a3cda5bd599 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:25.566 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.540+0000 7f70b498a700 1 -- 172.21.15.103:0/79945936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0128e0 con 0x7f70b006f4c0 2021-01-27T09:18:25.567 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.540+0000 7f70b498a700 1 -- 172.21.15.103:0/79945936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f70ac013030 con 0x7f70b006f4c0 2021-01-27T09:18:25.567 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.540+0000 7f70b7bf0700 1 -- 172.21.15.103:0/79945936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 msgr2=0x7f70b006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:25.568 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.540+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/79945936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f70ac009480 tx=0x7f70ac006ee0).stop 2021-01-27T09:18:25.569 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.552+0000 7f70b7bf0700 1 -- 172.21.15.103:0/79945936 shutdown_connections 2021-01-27T09:18:25.569 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.552+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/79945936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b006da60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:25.570 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.552+0000 7f70b7bf0700 1 -- 172.21.15.103:0/79945936 >> 172.21.15.103:0/79945936 conn(0x7f70b00f4c00 msgr2=0x7f70b00f7020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:25.571 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.560+0000 7f70b7bf0700 1 -- 172.21.15.103:0/79945936 shutdown_connections 2021-01-27T09:18:25.574 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.568+0000 7f70b7bf0700 1 -- 172.21.15.103:0/79945936 wait complete. 2021-01-27T09:18:25.574 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.568+0000 7f70b7bf0700 1 Processor -- start 2021-01-27T09:18:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.568+0000 7f70b7bf0700 1 -- start start 2021-01-27T09:18:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.572+0000 7f70b7bf0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.572+0000 7f70b7bf0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac01b3a0 con 0x7f70b006f4c0 2021-01-27T09:18:25.586 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.580+0000 7f70b598c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:25.587 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.580+0000 7f70b598c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49132/0 (socket says 172.21.15.103:49132) 2021-01-27T09:18:25.587 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.580+0000 7f70b598c700 1 -- 172.21.15.103:0/4238828178 learned_addr learned my addr 172.21.15.103:0/4238828178 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:25.588 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.580+0000 7f70b598c700 1 -- 172.21.15.103:0/4238828178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0116e30 con 0x7f70b006f4c0 2021-01-27T09:18:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.584+0000 7f70b598c700 1 --2- 172.21.15.103:0/4238828178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f70ac013520 tx=0x7f70ac006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:25.593 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.592+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac01a620 con 0x7f70b006f4c0 2021-01-27T09:18:25.595 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.592+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b0117080 con 0x7f70b006f4c0 2021-01-27T09:18:25.595 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.592+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b0117430 con 0x7f70b006f4c0 2021-01-27T09:18:25.596 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f70ac00c040 con 0x7f70b006f4c0 2021-01-27T09:18:25.597 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac01c9d0 con 0x7f70b006f4c0 2021-01-27T09:18:25.599 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f70ac01cbb0 con 0x7f70b006f4c0 2021-01-27T09:18:25.600 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f709e7fc700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:25.624 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f70b518b700 1 -- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 msgr2=0x7f7098032160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:25.625 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.596+0000 7f70b518b700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:18:25.625 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.600+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090004da0 con 0x7f70b006f4c0 2021-01-27T09:18:25.626 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.620+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f70ac041880 con 0x7f70b006f4c0 2021-01-27T09:18:25.633 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.632+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f70ac01ce40 con 0x7f70b006f4c0 2021-01-27T09:18:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.800+0000 7f70b518b700 1 -- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 msgr2=0x7f7098032160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:25.800+0000 7f70b518b700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:18:26.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:26.204+0000 7f70b518b700 1 -- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 msgr2=0x7f7098032160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:26.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:26.204+0000 7f70b518b700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-01-27T09:18:27.008 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.008+0000 7f70b518b700 1 -- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 msgr2=0x7f7098032160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:27.008 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.008+0000 7f70b518b700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-01-27T09:18:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.740+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7090005c80 con 0x7f70b006f4c0 2021-01-27T09:18:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.744+0000 7f709e7fc700 1 -- 172.21.15.103:0/4238828178 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f70ac023aa0 con 0x7f70b006f4c0 2021-01-27T09:18:27.756 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:27.756 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 5, 2021-01-27T09:18:27.757 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "available": true, 2021-01-27T09:18:27.757 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-27T09:18:27.757 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-27T09:18:27.757 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:27.786 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.780+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 msgr2=0x7f7098032160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:18:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.780+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.780+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 msgr2=0x7f70b0116940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.780+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/4238828178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f70ac013520 tx=0x7f70ac006ee0).stop 2021-01-27T09:18:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.788+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 shutdown_connections 2021-01-27T09:18:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.788+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/4238828178 >> v2:172.21.15.103:6800/9391381 conn(0x7f709802fca0 0x7f7098032160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.788+0000 7f70b7bf0700 1 --2- 172.21.15.103:0/4238828178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b006f4c0 0x7f70b0116940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.788+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 >> 172.21.15.103:0/4238828178 conn(0x7f70b00f4c00 msgr2=0x7f70b00fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:27.800 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.800+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 shutdown_connections 2021-01-27T09:18:27.810 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:27.808+0000 7f70b7bf0700 1 -- 172.21.15.103:0/4238828178 wait complete. 2021-01-27T09:18:28.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:27 smithi103 bash[9772]: audit 2021-01-27T09:18:27.743520+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.103:0/4238828178' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T09:18:28.719 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for the mgr to restart... 2021-01-27T09:18:28.719 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mgr epoch 5... 2021-01-27T09:18:28.719 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-27T09:18:31.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.144+0000 7fbd61339700 1 Processor -- start 2021-01-27T09:18:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.152+0000 7fbd61339700 1 -- start start 2021-01-27T09:18:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.152+0000 7fbd61339700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.152+0000 7fbd61339700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c101d80 con 0x7fbd5c101470 2021-01-27T09:18:31.173 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.168+0000 7fbd5affd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:31.174 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.168+0000 7fbd5affd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49146/0 (socket says 172.21.15.103:49146) 2021-01-27T09:18:31.174 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.168+0000 7fbd5affd700 1 -- 172.21.15.103:0/1077334238 learned_addr learned my addr 172.21.15.103:0/1077334238 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:31.185 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.184+0000 7fbd5affd700 1 -- 172.21.15.103:0/1077334238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c101ec0 con 0x7fbd5c101470 2021-01-27T09:18:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.188+0000 7fbd5affd700 1 --2- 172.21.15.103:0/1077334238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbd4c008930 tx=0x7fbd4c006f70).ready entity=mon.0 client_cookie=419dba4eadef5018 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.188+0000 7fbd59ffb700 1 -- 172.21.15.103:0/1077334238 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c010070 con 0x7fbd5c101470 2021-01-27T09:18:31.194 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.188+0000 7fbd59ffb700 1 -- 172.21.15.103:0/1077334238 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbd4c00dcc0 con 0x7fbd5c101470 2021-01-27T09:18:31.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.188+0000 7fbd59ffb700 1 -- 172.21.15.103:0/1077334238 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c014590 con 0x7fbd5c101470 2021-01-27T09:18:31.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.192+0000 7fbd61339700 1 -- 172.21.15.103:0/1077334238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 msgr2=0x7fbd5c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:31.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.192+0000 7fbd61339700 1 --2- 172.21.15.103:0/1077334238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbd4c008930 tx=0x7fbd4c006f70).stop 2021-01-27T09:18:31.195 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.192+0000 7fbd61339700 1 -- 172.21.15.103:0/1077334238 shutdown_connections 2021-01-27T09:18:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.192+0000 7fbd61339700 1 --2- 172.21.15.103:0/1077334238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c101890 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.192+0000 7fbd61339700 1 -- 172.21.15.103:0/1077334238 >> 172.21.15.103:0/1077334238 conn(0x7fbd5c063380 msgr2=0x7fbd5c0657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- 172.21.15.103:0/1077334238 shutdown_connections 2021-01-27T09:18:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- 172.21.15.103:0/1077334238 wait complete. 2021-01-27T09:18:31.198 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 Processor -- start 2021-01-27T09:18:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- start start 2021-01-27T09:18:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c10e630 con 0x7fbd5c101470 2021-01-27T09:18:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5affd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5affd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49148/0 (socket says 172.21.15.103:49148) 2021-01-27T09:18:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5affd700 1 -- 172.21.15.103:0/3086483972 learned_addr learned my addr 172.21.15.103:0/3086483972 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5affd700 1 -- 172.21.15.103:0/3086483972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c10e770 con 0x7fbd5c101470 2021-01-27T09:18:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5affd700 1 --2- 172.21.15.103:0/3086483972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbd4c00d7f0 tx=0x7fbd4c006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c010030 con 0x7fbd5c101470 2021-01-27T09:18:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbd4c0143d0 con 0x7fbd5c101470 2021-01-27T09:18:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c01d550 con 0x7fbd5c101470 2021-01-27T09:18:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c10e9c0 con 0x7fbd5c101470 2021-01-27T09:18:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c10f520 con 0x7fbd5c101470 2021-01-27T09:18:31.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7fbd4c02e070 con 0x7fbd5c101470 2021-01-27T09:18:31.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:31.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbd4c043c70 con 0x7fbd5c101470 2021-01-27T09:18:31.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5a7fc700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:31.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 --> v2:172.21.15.103:6800/9391381 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd5c045a30 con 0x7fbd4802fc10 2021-01-27T09:18:31.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.196+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:18:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.400+0000 7fbd5a7fc700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:31.403 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.400+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:18:31.807 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.804+0000 7fbd5a7fc700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:31.807 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:31.804+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-01-27T09:18:32.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:32.608+0000 7fbd5a7fc700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:32.609 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:32.608+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-01-27T09:18:34.214 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:34.212+0000 7fbd5a7fc700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/9391381 2021-01-27T09:18:34.214 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:34.212+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2021-01-27T09:18:37.124 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:37.124+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 6) v1 ==== 35656+0+0 (secure 0 0 0) 0x7fbd4c01e9c0 con 0x7fbd5c101470 2021-01-27T09:18:37.125 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:37.124+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 msgr2=0x7fbd480320d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:18:37.125 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:37.124+0000 7fbd437fe700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:38.127 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.124+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 7) v1 ==== 35691+0+0 (secure 0 0 0) 0x7fbd4c044e90 con 0x7fbd5c101470 2021-01-27T09:18:38.128 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.124+0000 7fbd437fe700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 0x7fbd480358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:38.128 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.124+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 --> v2:172.21.15.103:6800/2682866920 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd5c045a30 con 0x7fbd480334f0 2021-01-27T09:18:38.129 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.128+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 0x7fbd480358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:38.130 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.128+0000 7fbd5a7fc700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 0x7fbd480358e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fbd54003a50 tx=0x7fbd54009350).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:38.131 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.128+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mgr.14116 v2:172.21.15.103:6800/2682866920 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fbd5c045a30 con 0x7fbd480334f0 2021-01-27T09:18:38.147 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.144+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 --> v2:172.21.15.103:6800/2682866920 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fbd5c0581f0 con 0x7fbd480334f0 2021-01-27T09:18:38.147 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd437fe700 1 -- 172.21.15.103:0/3086483972 <== mgr.14116 v2:172.21.15.103:6800/2682866920 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbd5c0581f0 con 0x7fbd480334f0 2021-01-27T09:18:38.148 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:38.149 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-01-27T09:18:38.150 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "initialized": true 2021-01-27T09:18:38.150 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:38.150 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 msgr2=0x7fbd480358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:38.150 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 0x7fbd480358e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fbd54003a50 tx=0x7fbd54009350).stop 2021-01-27T09:18:38.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 msgr2=0x7fbd5c10e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:38.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 --2- 172.21.15.103:0/3086483972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbd4c00d7f0 tx=0x7fbd4c006f70).stop 2021-01-27T09:18:38.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 shutdown_connections 2021-01-27T09:18:38.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/2682866920 conn(0x7fbd480334f0 0x7fbd480358e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:38.151 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 --2- 172.21.15.103:0/3086483972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd5c101470 0x7fbd5c10e140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:38.152 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 --2- 172.21.15.103:0/3086483972 >> v2:172.21.15.103:6800/9391381 conn(0x7fbd4802fc10 0x7fbd480320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:38.152 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 >> 172.21.15.103:0/3086483972 conn(0x7fbd5c063380 msgr2=0x7fbd5c102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:38.152 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 shutdown_connections 2021-01-27T09:18:38.152 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:38.148+0000 7fbd61339700 1 -- 172.21.15.103:0/3086483972 wait complete. 2021-01-27T09:18:38.355 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: cluster 2021-01-27T09:18:37.071903+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-01-27T09:18:38.356 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: cluster 2021-01-27T09:18:37.072847+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-01-27T09:18:38.356 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: cluster 2021-01-27T09:18:37.076254+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-01-27T09:18:38.356 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: cluster 2021-01-27T09:18:37.127554+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0550033s) 2021-01-27T09:18:38.356 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.131652+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T09:18:38.357 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.132949+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T09:18:38.357 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.133346+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T09:18:38.357 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.133627+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T09:18:38.357 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.134231+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T09:18:38.357 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.135505+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T09:18:38.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.135996+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T09:18:38.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.136446+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T09:18:38.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.136903+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T09:18:38.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: cluster 2021-01-27T09:18:37.140984+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2021-01-27T09:18:38.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.160920+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:38.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.165764+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:38.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.170045+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:38.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.296681+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:38.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.304234+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:38.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.321992+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:18:38.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:38 smithi103 bash[9772]: audit 2021-01-27T09:18:37.324281+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:18:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:mgr epoch 5 is available 2021-01-27T09:18:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:Setting orchestrator backend to cephadm... 2021-01-27T09:18:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch set backend cephadm 2021-01-27T09:18:39.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:39 smithi103 bash[9772]: cluster 2021-01-27T09:18:38.131687+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.05913s) 2021-01-27T09:18:39.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:39 smithi103 bash[9772]: audit 2021-01-27T09:18:38.133196+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T09:18:39.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:39 smithi103 bash[9772]: audit 2021-01-27T09:18:38.150024+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T09:18:39.873 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854b59e700 1 Processor -- start 2021-01-27T09:18:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854b59e700 1 -- start start 2021-01-27T09:18:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0fd3d0 con 0x7f854c0fcac0 2021-01-27T09:18:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49184/0 (socket says 172.21.15.103:49184) 2021-01-27T09:18:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854a59c700 1 -- 172.21.15.103:0/4047122600 learned_addr learned my addr 172.21.15.103:0/4047122600 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854a59c700 1 -- 172.21.15.103:0/4047122600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0fd510 con 0x7f854c0fcac0 2021-01-27T09:18:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f854a59c700 1 --2- 172.21.15.103:0/4047122600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f853c00b950 tx=0x7f853c006ee0).ready entity=mon.0 client_cookie=147743b3f21f04ad server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f8549d9b700 1 -- 172.21.15.103:0/4047122600 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c009840 con 0x7f854c0fcac0 2021-01-27T09:18:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f8549d9b700 1 -- 172.21.15.103:0/4047122600 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f853c009e00 con 0x7f854c0fcac0 2021-01-27T09:18:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.872+0000 7f8549d9b700 1 -- 172.21.15.103:0/4047122600 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c011c80 con 0x7f854c0fcac0 2021-01-27T09:18:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/4047122600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 msgr2=0x7f854c0fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 --2- 172.21.15.103:0/4047122600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f853c00b950 tx=0x7f853c006ee0).stop 2021-01-27T09:18:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/4047122600 shutdown_connections 2021-01-27T09:18:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 --2- 172.21.15.103:0/4047122600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c0fcee0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/4047122600 >> 172.21.15.103:0/4047122600 conn(0x7f854c06ea50 msgr2=0x7f854c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/4047122600 shutdown_connections 2021-01-27T09:18:39.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/4047122600 wait complete. 2021-01-27T09:18:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 Processor -- start 2021-01-27T09:18:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- start start 2021-01-27T09:18:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c10a050 con 0x7f854c0fcac0 2021-01-27T09:18:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49186/0 (socket says 172.21.15.103:49186) 2021-01-27T09:18:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854a59c700 1 -- 172.21.15.103:0/147181485 learned_addr learned my addr 172.21.15.103:0/147181485 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:39.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854a59c700 1 -- 172.21.15.103:0/147181485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c10a190 con 0x7f854c0fcac0 2021-01-27T09:18:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854a59c700 1 --2- 172.21.15.103:0/147181485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f853c009fd0 tx=0x7f853c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c009ca0 con 0x7f854c0fcac0 2021-01-27T09:18:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f853c011400 con 0x7f854c0fcac0 2021-01-27T09:18:39.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f853c01bc00 con 0x7f854c0fcac0 2021-01-27T09:18:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.876+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c10a3e0 con 0x7f854c0fcac0 2021-01-27T09:18:39.884 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c10af40 con 0x7f854c0fcac0 2021-01-27T09:18:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f853c02b070 con 0x7f854c0fcac0 2021-01-27T09:18:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0581f0 con 0x7f854c0fcac0 2021-01-27T09:18:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f85437fe700 1 --2- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 0x7f852c032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f853c0418c0 con 0x7f854c0fcac0 2021-01-27T09:18:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f8541d9b700 1 --2- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 0x7f852c032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.880+0000 7f8541d9b700 1 --2- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 0x7f852c032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f85340096a0 tx=0x7f8534006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:39.888+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f853c01b620 con 0x7f854c0fcac0 2021-01-27T09:18:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.236+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 --> v2:172.21.15.103:6800/2682866920 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f854c0fbd90 con 0x7f852c02fb70 2021-01-27T09:18:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f85437fe700 1 -- 172.21.15.103:0/147181485 <== mgr.14116 v2:172.21.15.103:6800/2682866920 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f854c0fbd90 con 0x7f852c02fb70 2021-01-27T09:18:40.251 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 msgr2=0x7f852c032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:40.251 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 --2- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 0x7f852c032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f85340096a0 tx=0x7f8534006b40).stop 2021-01-27T09:18:40.252 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 msgr2=0x7f854c109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:40.252 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 --2- 172.21.15.103:0/147181485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f853c009fd0 tx=0x7f853c006ee0).stop 2021-01-27T09:18:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 shutdown_connections 2021-01-27T09:18:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 --2- 172.21.15.103:0/147181485 >> v2:172.21.15.103:6800/2682866920 conn(0x7f852c02fb70 0x7f852c032030 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 --2- 172.21.15.103:0/147181485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f854c0fcac0 0x7f854c109b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.248+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 >> 172.21.15.103:0/147181485 conn(0x7f854c06ea50 msgr2=0x7f854c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.252+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 shutdown_connections 2021-01-27T09:18:40.254 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:40.252+0000 7f854b59e700 1 -- 172.21.15.103:0/147181485 wait complete. 2021-01-27T09:18:40.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:40 smithi103 bash[9772]: cluster 2021-01-27T09:18:39.209500+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-01-27T09:18:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:Generating ssh key... 2021-01-27T09:18:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm generate-key 2021-01-27T09:18:41.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:41 smithi103 bash[9772]: audit 2021-01-27T09:18:40.240138+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:18:41.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:41 smithi103 bash[9772]: audit 2021-01-27T09:18:40.249398+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:41.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:41 smithi103 bash[9772]: audit 2021-01-27T09:18:40.261497+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:41.837 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4ac88b700 1 Processor -- start 2021-01-27T09:18:41.837 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4ac88b700 1 -- start start 2021-01-27T09:18:41.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4ac88b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:41.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4ac88b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8062a50 con 0x7fe4a8062140 2021-01-27T09:18:41.839 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:41.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49190/0 (socket says 172.21.15.103:49190) 2021-01-27T09:18:41.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a77fe700 1 -- 172.21.15.103:0/94870724 learned_addr learned my addr 172.21.15.103:0/94870724 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:41.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a77fe700 1 -- 172.21.15.103:0/94870724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8062b90 con 0x7fe4a8062140 2021-01-27T09:18:41.840 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a77fe700 1 --2- 172.21.15.103:0/94870724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe49000b950 tx=0x7fe490006ee0).ready entity=mon.0 client_cookie=c02bf9130d2e0e1a server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:41.841 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a67fc700 1 -- 172.21.15.103:0/94870724 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe490009840 con 0x7fe4a8062140 2021-01-27T09:18:41.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a67fc700 1 -- 172.21.15.103:0/94870724 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe490009e00 con 0x7fe4a8062140 2021-01-27T09:18:41.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.836+0000 7fe4a67fc700 1 -- 172.21.15.103:0/94870724 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe490011c80 con 0x7fe4a8062140 2021-01-27T09:18:41.843 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- 172.21.15.103:0/94870724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 msgr2=0x7fe4a8062560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:41.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/94870724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe49000b950 tx=0x7fe490006ee0).stop 2021-01-27T09:18:41.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- 172.21.15.103:0/94870724 shutdown_connections 2021-01-27T09:18:41.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/94870724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8062560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:41.844 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- 172.21.15.103:0/94870724 >> 172.21.15.103:0/94870724 conn(0x7fe4a8065390 msgr2=0x7fe4a80677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:41.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- 172.21.15.103:0/94870724 shutdown_connections 2021-01-27T09:18:41.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- 172.21.15.103:0/94870724 wait complete. 2021-01-27T09:18:41.845 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 Processor -- start 2021-01-27T09:18:41.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- start start 2021-01-27T09:18:41.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:41.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4ac88b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a81127f0 con 0x7fe4a8062140 2021-01-27T09:18:41.846 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4a77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:41.847 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4a77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49192/0 (socket says 172.21.15.103:49192) 2021-01-27T09:18:41.848 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4a77fe700 1 -- 172.21.15.103:0/2315054068 learned_addr learned my addr 172.21.15.103:0/2315054068 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.840+0000 7fe4a77fe700 1 -- 172.21.15.103:0/2315054068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8112930 con 0x7fe4a8062140 2021-01-27T09:18:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4a77fe700 1 --2- 172.21.15.103:0/2315054068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe490009420 tx=0x7fe490006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe490011ae0 con 0x7fe4a8062140 2021-01-27T09:18:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe490011400 con 0x7fe4a8062140 2021-01-27T09:18:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8112b80 con 0x7fe4a8062140 2021-01-27T09:18:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe49001bb90 con 0x7fe4a8062140 2021-01-27T09:18:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a81136e0 con 0x7fe4a8062140 2021-01-27T09:18:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c004da0 con 0x7fe4a8062140 2021-01-27T09:18:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7fe49002b070 con 0x7fe4a8062140 2021-01-27T09:18:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 --2- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 0x7fe488032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7fe490041780 con 0x7fe4a8062140 2021-01-27T09:18:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4a6ffd700 1 --2- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 0x7fe488032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:41.853 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.844+0000 7fe4a6ffd700 1 --2- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 0x7fe488032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe4a00089e0 tx=0x7fe4a0006ec0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:41.853 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:41.852+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe49001be00 con 0x7fe4a8062140 2021-01-27T09:18:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.140+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 --> v2:172.21.15.103:6800/2682866920 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe48c000bc0 con 0x7fe48802fb70 2021-01-27T09:18:42.323 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.320+0000 7fe49ffff700 1 -- 172.21.15.103:0/2315054068 <== mgr.14116 v2:172.21.15.103:6800/2682866920 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe48c000bc0 con 0x7fe48802fb70 2021-01-27T09:18:42.327 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 msgr2=0x7fe488032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:42.327 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 0x7fe488032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe4a00089e0 tx=0x7fe4a0006ec0).stop 2021-01-27T09:18:42.327 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 msgr2=0x7fe4a8112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:42.328 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/2315054068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe490009420 tx=0x7fe490006ee0).stop 2021-01-27T09:18:42.329 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 shutdown_connections 2021-01-27T09:18:42.329 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/2315054068 >> v2:172.21.15.103:6800/2682866920 conn(0x7fe48802fb70 0x7fe488032030 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:42.329 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 --2- 172.21.15.103:0/2315054068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4a8062140 0x7fe4a8112300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:42.329 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.324+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 >> 172.21.15.103:0/2315054068 conn(0x7fe4a8065390 msgr2=0x7fe4a8106d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:42.329 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.328+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 shutdown_connections 2021-01-27T09:18:42.330 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:42.328+0000 7fe4ac88b700 1 -- 172.21.15.103:0/2315054068 wait complete. 2021-01-27T09:18:42.529 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[9772]: audit 2021-01-27T09:18:42.144070+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:18:42.530 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[9772]: cephadm 2021-01-27T09:18:42.144539+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2021-01-27T09:18:42.530 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: Generating public/private rsa key pair. 2021-01-27T09:18:42.530 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: Your identification has been saved in /tmp/tmpcqo4sinz/key. 2021-01-27T09:18:42.530 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: Your public key has been saved in /tmp/tmpcqo4sinz/key.pub. 2021-01-27T09:18:42.531 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: The key fingerprint is: 2021-01-27T09:18:42.531 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: SHA256:ihulBDh4RoLTcBhFKBcdOIs8ZTMwDB775XlbJyTgKQw ceph-78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:42.531 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: The key's randomart image is: 2021-01-27T09:18:42.531 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: +---[RSA 3072]----+ 2021-01-27T09:18:42.531 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: |OEB+.o | 2021-01-27T09:18:42.532 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: |O*@=o o | 2021-01-27T09:18:42.532 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: |***=o+ . . | 2021-01-27T09:18:42.532 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: |.*o.+ . o | 2021-01-27T09:18:42.532 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: | ...o..So . | 2021-01-27T09:18:42.532 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: | . +..o o | 2021-01-27T09:18:42.533 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: | + .. | 2021-01-27T09:18:42.533 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: | o | 2021-01-27T09:18:42.533 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: | . | 2021-01-27T09:18:42.533 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:42 smithi103 bash[10018]: +----[SHA256]-----+ 2021-01-27T09:18:42.976 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm get-pub-key 2021-01-27T09:18:43.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:43 smithi103 bash[9772]: audit 2021-01-27T09:18:42.318300+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:43.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:43 smithi103 bash[9772]: audit 2021-01-27T09:18:42.322417+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:44.032 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 Processor -- start 2021-01-27T09:18:44.032 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- start start 2021-01-27T09:18:44.033 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:44.033 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40f9b00 con 0x7f13e40f91f0 2021-01-27T09:18:44.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:44.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49196/0 (socket says 172.21.15.103:49196) 2021-01-27T09:18:44.035 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e3fff700 1 -- 172.21.15.103:0/1846227833 learned_addr learned my addr 172.21.15.103:0/1846227833 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:44.035 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e3fff700 1 -- 172.21.15.103:0/1846227833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40f9c40 con 0x7f13e40f91f0 2021-01-27T09:18:44.035 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e3fff700 1 --2- 172.21.15.103:0/1846227833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f13cc00b950 tx=0x7f13cc006ee0).ready entity=mon.0 client_cookie=8a618732e862873b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e2ffd700 1 -- 172.21.15.103:0/1846227833 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc009840 con 0x7f13e40f91f0 2021-01-27T09:18:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e2ffd700 1 -- 172.21.15.103:0/1846227833 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f13cc009e00 con 0x7f13e40f91f0 2021-01-27T09:18:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e2ffd700 1 -- 172.21.15.103:0/1846227833 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc011c80 con 0x7f13e40f91f0 2021-01-27T09:18:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- 172.21.15.103:0/1846227833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 msgr2=0x7f13e40f9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 --2- 172.21.15.103:0/1846227833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f13cc00b950 tx=0x7f13cc006ee0).stop 2021-01-27T09:18:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- 172.21.15.103:0/1846227833 shutdown_connections 2021-01-27T09:18:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 --2- 172.21.15.103:0/1846227833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e40f9610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:44.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- 172.21.15.103:0/1846227833 >> 172.21.15.103:0/1846227833 conn(0x7f13e40f4a30 msgr2=0x7f13e40f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:44.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- 172.21.15.103:0/1846227833 shutdown_connections 2021-01-27T09:18:44.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.032+0000 7f13e903d700 1 -- 172.21.15.103:0/1846227833 wait complete. 2021-01-27T09:18:44.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 Processor -- start 2021-01-27T09:18:44.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 -- start start 2021-01-27T09:18:44.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:44.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4109f90 con 0x7f13e40f91f0 2021-01-27T09:18:44.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:44.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49198/0 (socket says 172.21.15.103:49198) 2021-01-27T09:18:44.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e3fff700 1 -- 172.21.15.103:0/2240576586 learned_addr learned my addr 172.21.15.103:0/2240576586 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:44.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e3fff700 1 -- 172.21.15.103:0/2240576586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e410a0d0 con 0x7f13e40f91f0 2021-01-27T09:18:44.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e3fff700 1 --2- 172.21.15.103:0/2240576586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13cc009fd0 tx=0x7f13cc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:44.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc009ca0 con 0x7f13e40f91f0 2021-01-27T09:18:44.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f13cc011400 con 0x7f13e40f91f0 2021-01-27T09:18:44.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e410a320 con 0x7f13e40f91f0 2021-01-27T09:18:44.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc01bc00 con 0x7f13e40f91f0 2021-01-27T09:18:44.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.036+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e410ae80 con 0x7f13e40f91f0 2021-01-27T09:18:44.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f13cc02b070 con 0x7f13e40f91f0 2021-01-27T09:18:44.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e0ff9700 1 --2- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 0x7f13c4032080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:44.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f13cc0418b0 con 0x7f13e40f91f0 2021-01-27T09:18:44.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e37fe700 1 --2- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 0x7f13c4032080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:44.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e37fe700 1 --2- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 0x7f13c4032080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f13d40089e0 tx=0x7f13d4006ec0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:44.045 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.040+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e40581f0 con 0x7f13e40f91f0 2021-01-27T09:18:44.048 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.048+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f13cc016070 con 0x7f13e40f91f0 2021-01-27T09:18:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.340+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 --> v2:172.21.15.103:6800/2682866920 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f13e40fb0f0 con 0x7f13c402fbc0 2021-01-27T09:18:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.340+0000 7f13e0ff9700 1 -- 172.21.15.103:0/2240576586 <== mgr.14116 v2:172.21.15.103:6800/2682866920 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f13e40fb0f0 con 0x7f13c402fbc0 2021-01-27T09:18:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBi5yE43/46TS6awZlge9jCWp+fVQu2ZuGmiduF6N5RQ1Hs1GJmbOPM7weuYhTKlbBg0wyAUVJR8qTPeaeDnZ884m3JieMjHRI9Z8yYPKIrq/9i4dVe28qyWFtRPyfl4YMQTiP56yAjQwwMvCPr4Zy2D1MXR9XG6I1NV4SZlRhDP0iDeQmRbafp590GiCGeSKlxICrJZofft9kQuPVZ6ecY99sJw9fYpD73Zi4csmbuq9cPVPl7DVgCs3+QFalQNv51OI2l4zJnAXbnkbndFVOjSgNZS0MiQp+WUmBGO7+YhwXRcIk985wCj5H1URnnic2oTODaU2Pm5q6uFEWAAOERES0QT3MZW2w0R/TNRWekpMiDdNGeojEqqTuiPcPu6dQUBgLFrmUl91p63WH6KzjGfYJRUT9tXtS/2eDYUyyTnykrmHmXOtGwlwhFtk8n+T8a0YbhrO3LXOWtyFbJHG3VMI9n9/76V//UZgtGRaf9jUdEpc3PuKMw4fiw3JJT6U= ceph-78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:18:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 msgr2=0x7f13c4032080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 --2- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 0x7f13c4032080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f13d40089e0 tx=0x7f13d4006ec0).stop 2021-01-27T09:18:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 msgr2=0x7f13e4109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 --2- 172.21.15.103:0/2240576586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13cc009fd0 tx=0x7f13cc006ee0).stop 2021-01-27T09:18:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 shutdown_connections 2021-01-27T09:18:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 --2- 172.21.15.103:0/2240576586 >> v2:172.21.15.103:6800/2682866920 conn(0x7f13c402fbc0 0x7f13c4032080 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:44.346 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 --2- 172.21.15.103:0/2240576586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13e40f91f0 0x7f13e4109aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:44.346 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 >> 172.21.15.103:0/2240576586 conn(0x7f13e40f4a30 msgr2=0x7f13e40f57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:44.346 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 shutdown_connections 2021-01-27T09:18:44.346 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:44.344+0000 7f13e903d700 1 -- 172.21.15.103:0/2240576586 wait complete. 2021-01-27T09:18:44.966 INFO:teuthology.orchestra.run.smithi103.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-01-27T09:18:44.967 INFO:teuthology.orchestra.run.smithi103.stderr:Adding key to root@localhost's authorized_keys... 2021-01-27T09:18:44.967 INFO:teuthology.orchestra.run.smithi103.stderr:Adding host smithi103... 2021-01-27T09:18:44.968 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch host add smithi103 2021-01-27T09:18:45.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:45 smithi103 bash[9772]: audit 2021-01-27T09:18:44.344121+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:18:46.031 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e8d69c700 1 Processor -- start 2021-01-27T09:18:46.032 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e8d69c700 1 -- start start 2021-01-27T09:18:46.032 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e8d69c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e8d69c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880f8170 con 0x7f6e880f7860 2021-01-27T09:18:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49202/0 (socket says 172.21.15.103:49202) 2021-01-27T09:18:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.027+0000 7f6e87fff700 1 -- 172.21.15.103:0/731378654 learned_addr learned my addr 172.21.15.103:0/731378654 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e87fff700 1 -- 172.21.15.103:0/731378654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880f82b0 con 0x7f6e880f7860 2021-01-27T09:18:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e87fff700 1 --2- 172.21.15.103:0/731378654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6e7800b950 tx=0x7f6e78006ee0).ready entity=mon.0 client_cookie=566ed50f3311e43d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e877fe700 1 -- 172.21.15.103:0/731378654 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e78009840 con 0x7f6e880f7860 2021-01-27T09:18:46.035 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e877fe700 1 -- 172.21.15.103:0/731378654 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f6e78009e00 con 0x7f6e880f7860 2021-01-27T09:18:46.035 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e877fe700 1 -- 172.21.15.103:0/731378654 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e78011c80 con 0x7f6e880f7860 2021-01-27T09:18:46.036 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- 172.21.15.103:0/731378654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 msgr2=0x7f6e880f7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:46.036 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/731378654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6e7800b950 tx=0x7f6e78006ee0).stop 2021-01-27T09:18:46.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- 172.21.15.103:0/731378654 shutdown_connections 2021-01-27T09:18:46.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/731378654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e880f7c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:46.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- 172.21.15.103:0/731378654 >> 172.21.15.103:0/731378654 conn(0x7f6e880f30a0 msgr2=0x7f6e880f54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:46.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- 172.21.15.103:0/731378654 shutdown_connections 2021-01-27T09:18:46.037 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- 172.21.15.103:0/731378654 wait complete. 2021-01-27T09:18:46.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 Processor -- start 2021-01-27T09:18:46.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- start start 2021-01-27T09:18:46.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:46.038 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e8d69c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88107db0 con 0x7f6e880f7860 2021-01-27T09:18:46.039 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:46.039 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49204/0 (socket says 172.21.15.103:49204) 2021-01-27T09:18:46.039 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.031+0000 7f6e87fff700 1 -- 172.21.15.103:0/3296536544 learned_addr learned my addr 172.21.15.103:0/3296536544 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:46.039 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e87fff700 1 -- 172.21.15.103:0/3296536544 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88107ef0 con 0x7f6e880f7860 2021-01-27T09:18:46.040 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e87fff700 1 --2- 172.21.15.103:0/3296536544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e78000c00 tx=0x7f6e78006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:46.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e78009ca0 con 0x7f6e880f7860 2021-01-27T09:18:46.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f6e78010f00 con 0x7f6e880f7860 2021-01-27T09:18:46.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7801bc40 con 0x7f6e880f7860 2021-01-27T09:18:46.041 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e88108140 con 0x7f6e880f7860 2021-01-27T09:18:46.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88108ca0 con 0x7f6e880f7860 2021-01-27T09:18:46.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f6e7802b070 con 0x7f6e880f7860 2021-01-27T09:18:46.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 --2- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 0x7f6e68032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:46.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f6e78041810 con 0x7f6e880f7860 2021-01-27T09:18:46.042 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e7ffff700 1 --2- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 0x7f6e68032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:46.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e7ffff700 1 --2- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 0x7f6e68032030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6e700096a0 tx=0x7f6e70006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:46.043 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.035+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e880581f0 con 0x7f6e880f7860 2021-01-27T09:18:46.044 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.043+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f6e780228e0 con 0x7f6e880f7860 2021-01-27T09:18:46.384 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:46.379+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 --> v2:172.21.15.103:6800/2682866920 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e880f9630 con 0x7f6e6802fb70 2021-01-27T09:18:46.893 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:46 smithi103 bash[10018]: Warning: Permanently added 'smithi103,172.21.15.103' (ECDSA) to the list of known hosts. 2021-01-27T09:18:47.137 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.135+0000 7f6e857fa700 1 -- 172.21.15.103:0/3296536544 <== mgr.14116 v2:172.21.15.103:6800/2682866920 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f6e880f9630 con 0x7f6e6802fb70 2021-01-27T09:18:47.137 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: Added host 'smithi103' 2021-01-27T09:18:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.135+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 msgr2=0x7f6e68032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.135+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 0x7f6e68032030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6e700096a0 tx=0x7f6e70006b40).stop 2021-01-27T09:18:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.135+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 msgr2=0x7f6e881078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:47.142 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.135+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/3296536544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e78000c00 tx=0x7f6e78006ee0).stop 2021-01-27T09:18:47.142 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 shutdown_connections 2021-01-27T09:18:47.142 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/3296536544 >> v2:172.21.15.103:6800/2682866920 conn(0x7f6e6802fb70 0x7f6e68032030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 --2- 172.21.15.103:0/3296536544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e880f7860 0x7f6e881078c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 >> 172.21.15.103:0/3296536544 conn(0x7f6e880f30a0 msgr2=0x7f6e880f4650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 shutdown_connections 2021-01-27T09:18:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:47.139+0000 7f6e8d69c700 1 -- 172.21.15.103:0/3296536544 wait complete. 2021-01-27T09:18:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mgr mgr/dashboard/ssl_server_port 8443 2021-01-27T09:18:48.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:48 smithi103 bash[9772]: audit 2021-01-27T09:18:46.386912+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:18:48.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:48 smithi103 bash[9772]: audit 2021-01-27T09:18:47.135270+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:48.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:48 smithi103 bash[9772]: cephadm 2021-01-27T09:18:47.135984+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi103 2021-01-27T09:18:48.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:48 smithi103 bash[9772]: audit 2021-01-27T09:18:47.554575+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:48.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:48 smithi103 bash[9772]: audit 2021-01-27T09:18:47.555863+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:18:49.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.195+0000 7f9c569df700 1 Processor -- start 2021-01-27T09:18:49.201 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 -- start start 2021-01-27T09:18:49.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:49.202 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500fa090 con 0x7f9c500f96f0 2021-01-27T09:18:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c559dd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c559dd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49210/0 (socket says 172.21.15.103:49210) 2021-01-27T09:18:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c559dd700 1 -- 172.21.15.103:0/2558549740 learned_addr learned my addr 172.21.15.103:0/2558549740 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c559dd700 1 -- 172.21.15.103:0/2558549740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500fa1d0 con 0x7f9c500f96f0 2021-01-27T09:18:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c559dd700 1 --2- 172.21.15.103:0/2558549740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9c4800bf60 tx=0x7f9c4800b570).ready entity=mon.0 client_cookie=4aa9dddd01a38c11 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c549db700 1 -- 172.21.15.103:0/2558549740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c48010470 con 0x7f9c500f96f0 2021-01-27T09:18:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c549db700 1 -- 172.21.15.103:0/2558549740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f9c48010a30 con 0x7f9c500f96f0 2021-01-27T09:18:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c549db700 1 -- 172.21.15.103:0/2558549740 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c4800f860 con 0x7f9c500f96f0 2021-01-27T09:18:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 -- 172.21.15.103:0/2558549740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 msgr2=0x7f9c500f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 --2- 172.21.15.103:0/2558549740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9c4800bf60 tx=0x7f9c4800b570).stop 2021-01-27T09:18:49.206 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 -- 172.21.15.103:0/2558549740 shutdown_connections 2021-01-27T09:18:49.206 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 --2- 172.21.15.103:0/2558549740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c500f9b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:49.206 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.199+0000 7f9c569df700 1 -- 172.21.15.103:0/2558549740 >> 172.21.15.103:0/2558549740 conn(0x7f9c500f2fd0 msgr2=0x7f9c500f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:49.206 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- 172.21.15.103:0/2558549740 shutdown_connections 2021-01-27T09:18:49.207 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- 172.21.15.103:0/2558549740 wait complete. 2021-01-27T09:18:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 Processor -- start 2021-01-27T09:18:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- start start 2021-01-27T09:18:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5010a020 con 0x7f9c500f96f0 2021-01-27T09:18:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c559dd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c559dd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49212/0 (socket says 172.21.15.103:49212) 2021-01-27T09:18:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c559dd700 1 -- 172.21.15.103:0/2434189575 learned_addr learned my addr 172.21.15.103:0/2434189575 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c559dd700 1 -- 172.21.15.103:0/2434189575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5010a160 con 0x7f9c500f96f0 2021-01-27T09:18:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c559dd700 1 --2- 172.21.15.103:0/2434189575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9c4800f7d0 tx=0x7f9c4800b570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c480108d0 con 0x7f9c500f96f0 2021-01-27T09:18:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5010a3b0 con 0x7f9c500f96f0 2021-01-27T09:18:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5010af10 con 0x7f9c500f96f0 2021-01-27T09:18:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f9c48019ac0 con 0x7f9c500f96f0 2021-01-27T09:18:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.203+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c480218b0 con 0x7f9c500f96f0 2021-01-27T09:18:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f9c48029070 con 0x7f9c500f96f0 2021-01-27T09:18:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c4e7fc700 1 --2- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 0x7f9c3c032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c30004da0 con 0x7f9c500f96f0 2021-01-27T09:18:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f9c48042bf0 con 0x7f9c500f96f0 2021-01-27T09:18:49.213 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c551dc700 1 --2- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 0x7f9c3c032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:49.213 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.207+0000 7f9c551dc700 1 --2- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 0x7f9c3c032030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9c440096a0 tx=0x7f9c44006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:49.217 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.215+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f9c4801d080 con 0x7f9c500f96f0 2021-01-27T09:18:49.509 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.503+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9c300059f0 con 0x7f9c500f96f0 2021-01-27T09:18:49.515 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.511+0000 7f9c4e7fc700 1 -- 172.21.15.103:0/2434189575 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9c48014020 con 0x7f9c500f96f0 2021-01-27T09:18:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 msgr2=0x7f9c3c032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 --2- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 0x7f9c3c032030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9c440096a0 tx=0x7f9c44006b40).stop 2021-01-27T09:18:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 msgr2=0x7f9c50109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:49.520 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 --2- 172.21.15.103:0/2434189575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9c4800f7d0 tx=0x7f9c4800b570).stop 2021-01-27T09:18:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 shutdown_connections 2021-01-27T09:18:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 --2- 172.21.15.103:0/2434189575 >> v2:172.21.15.103:6800/2682866920 conn(0x7f9c3c02fb70 0x7f9c3c032030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:49.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 --2- 172.21.15.103:0/2434189575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c500f96f0 0x7f9c50109b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:49.522 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 >> 172.21.15.103:0/2434189575 conn(0x7f9c500f2fd0 msgr2=0x7f9c50100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:49.522 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 shutdown_connections 2021-01-27T09:18:49.522 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:49.515+0000 7f9c569df700 1 -- 172.21.15.103:0/2434189575 wait complete. 2021-01-27T09:18:49.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:49 smithi103 bash[9772]: audit 2021-01-27T09:18:48.318802+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' 2021-01-27T09:18:49.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:49 smithi103 bash[9772]: audit 2021-01-27T09:18:48.320348+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.103:0/833703697' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:18:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:Enabling the dashboard module... 2021-01-27T09:18:50.321 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable dashboard 2021-01-27T09:18:50.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:50 smithi103 bash[9772]: audit 2021-01-27T09:18:49.516062+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.103:0/2434189575' entity='client.admin' 2021-01-27T09:18:51.673 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 Processor -- start 2021-01-27T09:18:51.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- start start 2021-01-27T09:18:51.674 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:51.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880fbd00 con 0x7fac880fb3f0 2021-01-27T09:18:51.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac877fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:51.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac877fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49216/0 (socket says 172.21.15.103:49216) 2021-01-27T09:18:51.675 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac877fe700 1 -- 172.21.15.103:0/3314230520 learned_addr learned my addr 172.21.15.103:0/3314230520 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:51.676 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac877fe700 1 -- 172.21.15.103:0/3314230520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880fbe40 con 0x7fac880fb3f0 2021-01-27T09:18:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac877fe700 1 --2- 172.21.15.103:0/3314230520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fac78009cc0 tx=0x7fac780092d0).ready entity=mon.0 client_cookie=481d13ac397a0449 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac867fc700 1 -- 172.21.15.103:0/3314230520 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac7800bbf0 con 0x7fac880fb3f0 2021-01-27T09:18:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac867fc700 1 -- 172.21.15.103:0/3314230520 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fac7800bd50 con 0x7fac880fb3f0 2021-01-27T09:18:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac867fc700 1 -- 172.21.15.103:0/3314230520 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac78010560 con 0x7fac880fb3f0 2021-01-27T09:18:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- 172.21.15.103:0/3314230520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 msgr2=0x7fac880fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 --2- 172.21.15.103:0/3314230520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fac78009cc0 tx=0x7fac780092d0).stop 2021-01-27T09:18:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- 172.21.15.103:0/3314230520 shutdown_connections 2021-01-27T09:18:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 --2- 172.21.15.103:0/3314230520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac880fb3f0 0x7fac880fb810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- 172.21.15.103:0/3314230520 >> 172.21.15.103:0/3314230520 conn(0x7fac8806ea40 msgr2=0x7fac8806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- 172.21.15.103:0/3314230520 shutdown_connections 2021-01-27T09:18:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.671+0000 7fac8cfae700 1 -- 172.21.15.103:0/3314230520 wait complete. 2021-01-27T09:18:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 Processor -- start 2021-01-27T09:18:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 -- start start 2021-01-27T09:18:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8810a4a0 con 0x7fac88109b90 2021-01-27T09:18:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac877fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac877fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49218/0 (socket says 172.21.15.103:49218) 2021-01-27T09:18:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac877fe700 1 -- 172.21.15.103:0/195192584 learned_addr learned my addr 172.21.15.103:0/195192584 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac877fe700 1 -- 172.21.15.103:0/195192584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8810a5e0 con 0x7fac88109b90 2021-01-27T09:18:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac877fe700 1 --2- 172.21.15.103:0/195192584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fac78000f80 tx=0x7fac780092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac7800bbf0 con 0x7fac88109b90 2021-01-27T09:18:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fac7800bec0 con 0x7fac88109b90 2021-01-27T09:18:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8810afb0 con 0x7fac88109b90 2021-01-27T09:18:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac780233b0 con 0x7fac88109b90 2021-01-27T09:18:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8810b3c0 con 0x7fac88109b90 2021-01-27T09:18:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7fac7802b070 con 0x7fac88109b90 2021-01-27T09:18:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 --2- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 0x7fac68032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7fac78041f60 con 0x7fac88109b90 2021-01-27T09:18:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac86ffd700 1 --2- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 0x7fac68032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.675+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880581f0 con 0x7fac88109b90 2021-01-27T09:18:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.679+0000 7fac86ffd700 1 --2- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 0x7fac68032030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fac700096a0 tx=0x7fac70006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:51.683+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fac78018310 con 0x7fac88109b90 2021-01-27T09:18:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.043+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fac8810ba20 con 0x7fac88109b90 2021-01-27T09:18:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.099+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7fac78021030 con 0x7fac88109b90 2021-01-27T09:18:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.099+0000 7fac7ffff700 1 -- 172.21.15.103:0/195192584 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fac780063f0 con 0x7fac88109b90 2021-01-27T09:18:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 msgr2=0x7fac68032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 --2- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 0x7fac68032030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fac700096a0 tx=0x7fac70006b40).stop 2021-01-27T09:18:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 msgr2=0x7fac88109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 --2- 172.21.15.103:0/195192584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fac78000f80 tx=0x7fac780092d0).stop 2021-01-27T09:18:52.108 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 shutdown_connections 2021-01-27T09:18:52.108 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 --2- 172.21.15.103:0/195192584 >> v2:172.21.15.103:6800/2682866920 conn(0x7fac6802fb70 0x7fac68032030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:52.108 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 --2- 172.21.15.103:0/195192584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac88109b90 0x7fac88109fb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:52.108 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 >> 172.21.15.103:0/195192584 conn(0x7fac8806ea40 msgr2=0x7fac880fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:52.109 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 shutdown_connections 2021-01-27T09:18:52.109 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:52.103+0000 7fac8cfae700 1 -- 172.21.15.103:0/195192584 wait complete. 2021-01-27T09:18:52.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:52 smithi103 bash[9772]: audit 2021-01-27T09:18:52.047861+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.103:0/195192584' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-01-27T09:18:52.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:52 smithi103 bash[10018]: ignoring --setuser ceph since I am not root 2021-01-27T09:18:52.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:52 smithi103 bash[10018]: ignoring --setgroup ceph since I am not root 2021-01-27T09:18:52.784 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-27T09:18:53.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:53 smithi103 bash[9772]: audit 2021-01-27T09:18:52.104324+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.103:0/195192584' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-01-27T09:18:53.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:53 smithi103 bash[9772]: cluster 2021-01-27T09:18:52.104450+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 15s) 2021-01-27T09:18:53.872 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0ff198f700 1 Processor -- start 2021-01-27T09:18:53.872 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0ff198f700 1 -- start start 2021-01-27T09:18:53.872 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0ff198f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:53.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0ff198f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec06f8e0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:53.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49234/0 (socket says 172.21.15.103:49234) 2021-01-27T09:18:53.874 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.867+0000 7f0feaffd700 1 -- 172.21.15.103:0/1081278041 learned_addr learned my addr 172.21.15.103:0/1081278041 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 -- 172.21.15.103:0/1081278041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06df50 con 0x7f0fec06f4c0 2021-01-27T09:18:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 --2- 172.21.15.103:0/1081278041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0fdc00b950 tx=0x7f0fdc006ee0).ready entity=mon.0 client_cookie=d89b441f90c13e47 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0fe9ffb700 1 -- 172.21.15.103:0/1081278041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc009840 con 0x7f0fec06f4c0 2021-01-27T09:18:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0fe9ffb700 1 -- 172.21.15.103:0/1081278041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0fdc009e00 con 0x7f0fec06f4c0 2021-01-27T09:18:53.876 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0fe9ffb700 1 -- 172.21.15.103:0/1081278041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc011c80 con 0x7f0fec06f4c0 2021-01-27T09:18:53.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- 172.21.15.103:0/1081278041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 msgr2=0x7f0fec06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:53.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 --2- 172.21.15.103:0/1081278041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0fdc00b950 tx=0x7f0fdc006ee0).stop 2021-01-27T09:18:53.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- 172.21.15.103:0/1081278041 shutdown_connections 2021-01-27T09:18:53.878 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 --2- 172.21.15.103:0/1081278041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec06da60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:53.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- 172.21.15.103:0/1081278041 >> 172.21.15.103:0/1081278041 conn(0x7f0fec0f4c00 msgr2=0x7f0fec0f7020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:53.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- 172.21.15.103:0/1081278041 shutdown_connections 2021-01-27T09:18:53.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- 172.21.15.103:0/1081278041 wait complete. 2021-01-27T09:18:53.879 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 Processor -- start 2021-01-27T09:18:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- start start 2021-01-27T09:18:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0ff198f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec10a270 con 0x7f0fec06f4c0 2021-01-27T09:18:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49236/0 (socket says 172.21.15.103:49236) 2021-01-27T09:18:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 -- 172.21.15.103:0/2712233400 learned_addr learned my addr 172.21.15.103:0/2712233400 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.871+0000 7f0feaffd700 1 -- 172.21.15.103:0/2712233400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec10a3b0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0feaffd700 1 --2- 172.21.15.103:0/2712233400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fdc0107e0 tx=0x7f0fdc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc009ca0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0fdc011400 con 0x7f0fec06f4c0 2021-01-27T09:18:53.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc01ba70 con 0x7f0fec06f4c0 2021-01-27T09:18:53.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec10a600 con 0x7f0fec06f4c0 2021-01-27T09:18:53.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec10b0b0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.882 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f0fdc00f070 con 0x7f0fec06f4c0 2021-01-27T09:18:53.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 --2- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 0x7f0fd8032020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:53.883 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f0fdc0412c0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fea7fc700 1 -- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 msgr2=0x7f0fd8032020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0fea7fc700 1 --2- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 0x7f0fd8032020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:18:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.875+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec044bc0 con 0x7f0fec06f4c0 2021-01-27T09:18:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:53.879+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f0fdc016030 con 0x7f0fec06f4c0 2021-01-27T09:18:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.079+0000 7f0fea7fc700 1 -- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 msgr2=0x7f0fd8032020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.079+0000 7f0fea7fc700 1 --2- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 0x7f0fd8032020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:18:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.235+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0fec10b780 con 0x7f0fec06f4c0 2021-01-27T09:18:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.235+0000 7f0fd37fe700 1 -- 172.21.15.103:0/2712233400 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f0fdc019300 con 0x7f0fec06f4c0 2021-01-27T09:18:54.240 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "epoch": 9, 2021-01-27T09:18:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "available": true, 2021-01-27T09:18:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-27T09:18:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-27T09:18:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 msgr2=0x7f0fd8032020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:18:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 --2- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 0x7f0fd8032020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 msgr2=0x7f0fec109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 --2- 172.21.15.103:0/2712233400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fdc0107e0 tx=0x7f0fdc006ee0).stop 2021-01-27T09:18:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 shutdown_connections 2021-01-27T09:18:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 --2- 172.21.15.103:0/2712233400 >> v2:172.21.15.103:6800/2682866920 conn(0x7f0fd802fb60 0x7f0fd8032020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 --2- 172.21.15.103:0/2712233400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec06f4c0 0x7f0fec109d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:54.246 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 >> 172.21.15.103:0/2712233400 conn(0x7f0fec0f4c00 msgr2=0x7f0fec0f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:54.246 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 shutdown_connections 2021-01-27T09:18:54.246 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:54.239+0000 7f0ff198f700 1 -- 172.21.15.103:0/2712233400 wait complete. 2021-01-27T09:18:54.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:54 smithi103 bash[9772]: audit 2021-01-27T09:18:54.241013+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.103:0/2712233400' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T09:18:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for the mgr to restart... 2021-01-27T09:18:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:Waiting for mgr epoch 9... 2021-01-27T09:18:54.900 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-27T09:18:55.964 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.959+0000 7f7c4b229700 1 Processor -- start 2021-01-27T09:18:55.964 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.959+0000 7f7c4b229700 1 -- start start 2021-01-27T09:18:55.965 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.959+0000 7f7c4b229700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:55.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.959+0000 7f7c4b229700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440fc3a0 con 0x7f7c4406d400 2021-01-27T09:18:55.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4a227700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:55.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4a227700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49244/0 (socket says 172.21.15.103:49244) 2021-01-27T09:18:55.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4a227700 1 -- 172.21.15.103:0/1549951505 learned_addr learned my addr 172.21.15.103:0/1549951505 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:55.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4a227700 1 -- 172.21.15.103:0/1549951505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440fc4e0 con 0x7f7c4406d400 2021-01-27T09:18:55.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4a227700 1 --2- 172.21.15.103:0/1549951505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7c4000b950 tx=0x7f7c40006ee0).ready entity=mon.0 client_cookie=903978b31962dc39 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:55.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c49225700 1 -- 172.21.15.103:0/1549951505 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c400098d0 con 0x7f7c4406d400 2021-01-27T09:18:55.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c49225700 1 -- 172.21.15.103:0/1549951505 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7c40009e90 con 0x7f7c4406d400 2021-01-27T09:18:55.968 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c49225700 1 -- 172.21.15.103:0/1549951505 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c40011d10 con 0x7f7c4406d400 2021-01-27T09:18:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- 172.21.15.103:0/1549951505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 msgr2=0x7f7c440fbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1549951505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7c4000b950 tx=0x7f7c40006ee0).stop 2021-01-27T09:18:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- 172.21.15.103:0/1549951505 shutdown_connections 2021-01-27T09:18:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1549951505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c440fbeb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- 172.21.15.103:0/1549951505 >> 172.21.15.103:0/1549951505 conn(0x7f7c440f3930 msgr2=0x7f7c440f5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:55.971 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- 172.21.15.103:0/1549951505 shutdown_connections 2021-01-27T09:18:55.971 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- 172.21.15.103:0/1549951505 wait complete. 2021-01-27T09:18:55.971 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 Processor -- start 2021-01-27T09:18:55.971 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.963+0000 7f7c4b229700 1 -- start start 2021-01-27T09:18:55.971 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4b229700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4b229700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4410a040 con 0x7f7c4406d400 2021-01-27T09:18:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4a227700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4a227700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49246/0 (socket says 172.21.15.103:49246) 2021-01-27T09:18:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4a227700 1 -- 172.21.15.103:0/1597141884 learned_addr learned my addr 172.21.15.103:0/1597141884 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:18:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4a227700 1 -- 172.21.15.103:0/1597141884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4410a180 con 0x7f7c4406d400 2021-01-27T09:18:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4a227700 1 --2- 172.21.15.103:0/1597141884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7c40000c00 tx=0x7f7c40006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c40009d30 con 0x7f7c4406d400 2021-01-27T09:18:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7c40011b50 con 0x7f7c4406d400 2021-01-27T09:18:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c4001bac0 con 0x7f7c4406d400 2021-01-27T09:18:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4410a3d0 con 0x7f7c4406d400 2021-01-27T09:18:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4410af30 con 0x7f7c4406d400 2021-01-27T09:18:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f7c4000f070 con 0x7f7c4406d400 2021-01-27T09:18:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 --> v2:172.21.15.103:6800/2682866920 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c440581f0 con 0x7f7c2c02fb70 2021-01-27T09:18:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.967+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f7c40040ed0 con 0x7f7c4406d400 2021-01-27T09:18:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.971+0000 7f7c49a26700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 msgr2=0x7f7c2c032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:55.971+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:18:56.177 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:56.175+0000 7f7c49a26700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 msgr2=0x7f7c2c032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:56.177 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:56.175+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:18:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:56.579+0000 7f7c49a26700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 msgr2=0x7f7c2c032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:56.579+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-01-27T09:18:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:57.383+0000 7f7c49a26700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 msgr2=0x7f7c2c032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2682866920 2021-01-27T09:18:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:57.383+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-01-27T09:18:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:58.103+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 10) v1 ==== 35669+0+0 (secure 0 0 0) 0x7f7c40010cc0 con 0x7f7c4406d400 2021-01-27T09:18:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:58.103+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 msgr2=0x7f7c2c032030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:18:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:58.103+0000 7f7c32ffd700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:58.360 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:18:58 smithi103 bash[10018]: Warning: Permanently added 'smithi103,172.21.15.103' (ECDSA) to the list of known hosts. 2021-01-27T09:18:58.361 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:58 smithi103 bash[9772]: cluster 2021-01-27T09:18:58.052008+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2021-01-27T09:18:58.361 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:58 smithi103 bash[9772]: cluster 2021-01-27T09:18:58.052750+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2021-01-27T09:18:58.361 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:58 smithi103 bash[9772]: cluster 2021-01-27T09:18:58.056462+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-01-27T09:18:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.111+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 11) v1 ==== 35704+0+0 (secure 0 0 0) 0x7f7c40022aa0 con 0x7f7c4406d400 2021-01-27T09:18:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.111+0000 7f7c32ffd700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 0x7f7c2c035930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:18:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.111+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 --> v2:172.21.15.103:6800/3303543367 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c440581f0 con 0x7f7c2c033540 2021-01-27T09:18:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.111+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 0x7f7c2c035930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:18:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.111+0000 7f7c49a26700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 0x7f7c2c035930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f7c340036d0 tx=0x7f7c34006ce0).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:18:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.115+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f7c440581f0 con 0x7f7c2c033540 2021-01-27T09:18:59.130 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 --> v2:172.21.15.103:6800/3303543367 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7c44044bc0 con 0x7f7c2c033540 2021-01-27T09:18:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c32ffd700 1 -- 172.21.15.103:0/1597141884 <== mgr.14138 v2:172.21.15.103:6800/3303543367 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f7c44044bc0 con 0x7f7c2c033540 2021-01-27T09:18:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: { 2021-01-27T09:18:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-01-27T09:18:59.132 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: "initialized": true 2021-01-27T09:18:59.132 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: } 2021-01-27T09:18:59.132 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 msgr2=0x7f7c2c035930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:59.132 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 0x7f7c2c035930 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f7c340036d0 tx=0x7f7c34006ce0).stop 2021-01-27T09:18:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 msgr2=0x7f7c44109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:18:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1597141884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7c40000c00 tx=0x7f7c40006ee0).stop 2021-01-27T09:18:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 shutdown_connections 2021-01-27T09:18:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7c2c033540 0x7f7c2c035930 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1597141884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c4406d400 0x7f7c44109b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:18:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 --2- 172.21.15.103:0/1597141884 >> v2:172.21.15.103:6800/2682866920 conn(0x7f7c2c02fb70 0x7f7c2c032030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:18:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 >> 172.21.15.103:0/1597141884 conn(0x7f7c440f3930 msgr2=0x7f7c440f4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:18:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 shutdown_connections 2021-01-27T09:18:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:18:59.127+0000 7f7c4b229700 1 -- 172.21.15.103:0/1597141884 wait complete. 2021-01-27T09:18:59.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: cluster 2021-01-27T09:18:58.108895+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0562531s) 2021-01-27T09:18:59.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.116382+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T09:18:59.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.117613+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T09:18:59.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.118187+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T09:18:59.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.118456+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T09:18:59.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.118958+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T09:18:59.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.120119+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi103"}]: dispatch 2021-01-27T09:18:59.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.120630+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-01-27T09:18:59.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.120997+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-01-27T09:18:59.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.121358+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-01-27T09:18:59.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.121745+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-01-27T09:18:59.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.122113+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T09:18:59.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.122546+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T09:18:59.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.122912+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T09:18:59.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.123246+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T09:18:59.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: cluster 2021-01-27T09:18:58.126764+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2021-01-27T09:18:59.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.315615+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:18:59.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.318310+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:18:59.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:18:59 smithi103 bash[9772]: audit 2021-01-27T09:18:58.511302+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:18:59.982 INFO:teuthology.orchestra.run.smithi103.stderr:mgr epoch 9 is available 2021-01-27T09:18:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:Generating a dashboard self-signed certificate... 2021-01-27T09:18:59.983 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard create-self-signed-cert 2021-01-27T09:19:00.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:00 smithi103 bash[9772]: audit 2021-01-27T09:18:59.118187+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T09:19:00.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:00 smithi103 bash[9772]: cluster 2021-01-27T09:18:59.118758+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: y(active, since 1.06612s) 2021-01-27T09:19:00.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:00 smithi103 bash[9772]: audit 2021-01-27T09:18:59.132449+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T09:19:00.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:00 smithi103 bash[9772]: audit 2021-01-27T09:18:59.235496+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:00.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:00 smithi103 bash[9772]: audit 2021-01-27T09:18:59.236484+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:19:01.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:01 smithi103 bash[9772]: cluster 2021-01-27T09:19:00.238880+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-01-27T09:19:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 Processor -- start 2021-01-27T09:19:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 -- start start 2021-01-27T09:19:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40f9b10 con 0x7f71d40f9200 2021-01-27T09:19:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d2ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:01.773 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d2ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49280/0 (socket says 172.21.15.103:49280) 2021-01-27T09:19:01.773 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d2ffd700 1 -- 172.21.15.103:0/2362496832 learned_addr learned my addr 172.21.15.103:0/2362496832 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:01.774 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d2ffd700 1 -- 172.21.15.103:0/2362496832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40f9c50 con 0x7f71d40f9200 2021-01-27T09:19:01.774 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d2ffd700 1 --2- 172.21.15.103:0/2362496832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f71c400b950 tx=0x7f71c4006ee0).ready entity=mon.0 client_cookie=cdee08735524ef9c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:01.774 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d27fc700 1 -- 172.21.15.103:0/2362496832 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71c4009840 con 0x7f71d40f9200 2021-01-27T09:19:01.775 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d27fc700 1 -- 172.21.15.103:0/2362496832 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f71c4009e00 con 0x7f71d40f9200 2021-01-27T09:19:01.775 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d27fc700 1 -- 172.21.15.103:0/2362496832 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71c4011c80 con 0x7f71d40f9200 2021-01-27T09:19:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 -- 172.21.15.103:0/2362496832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 msgr2=0x7f71d40f9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2362496832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f71c400b950 tx=0x7f71c4006ee0).stop 2021-01-27T09:19:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 -- 172.21.15.103:0/2362496832 shutdown_connections 2021-01-27T09:19:01.782 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2362496832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d40f9620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:01.782 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.767+0000 7f71d3fff700 1 -- 172.21.15.103:0/2362496832 >> 172.21.15.103:0/2362496832 conn(0x7f71d40f4a40 msgr2=0x7f71d40f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- 172.21.15.103:0/2362496832 shutdown_connections 2021-01-27T09:19:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- 172.21.15.103:0/2362496832 wait complete. 2021-01-27T09:19:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 Processor -- start 2021-01-27T09:19:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- start start 2021-01-27T09:19:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d406da00 con 0x7f71d40f9200 2021-01-27T09:19:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d2ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d2ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49282/0 (socket says 172.21.15.103:49282) 2021-01-27T09:19:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d2ffd700 1 -- 172.21.15.103:0/2898310033 learned_addr learned my addr 172.21.15.103:0/2898310033 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:01.787 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d2ffd700 1 -- 172.21.15.103:0/2898310033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d406db40 con 0x7f71d40f9200 2021-01-27T09:19:01.787 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d2ffd700 1 --2- 172.21.15.103:0/2898310033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f71c4009fd0 tx=0x7f71c4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71c4009ca0 con 0x7f71d40f9200 2021-01-27T09:19:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f71c4011400 con 0x7f71d40f9200 2021-01-27T09:19:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d406dd30 con 0x7f71d40f9200 2021-01-27T09:19:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71c401bc00 con 0x7f71d40f9200 2021-01-27T09:19:01.790 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d406e1c0 con 0x7f71d40f9200 2021-01-27T09:19:01.790 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f71c402b070 con 0x7f71d40f9200 2021-01-27T09:19:01.790 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.771+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d40581f0 con 0x7f71d40f9200 2021-01-27T09:19:01.791 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.775+0000 7f71cb7fe700 1 --2- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 0x7f71b4032080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:01.791 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.775+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f71c4011700 con 0x7f71d40f9200 2021-01-27T09:19:01.792 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.775+0000 7f71cbfff700 1 --2- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 0x7f71b4032080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:01.792 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.775+0000 7f71cbfff700 1 --2- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 0x7f71b4032080 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f71bc0095f0 tx=0x7f71bc006b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:01.792 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:01.779+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f71c4022d70 con 0x7f71d40f9200 2021-01-27T09:19:02.077 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.075+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f71d40fb0a0 con 0x7f71b402fbc0 2021-01-27T09:19:02.170 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71cb7fe700 1 -- 172.21.15.103:0/2898310033 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f71d40fb0a0 con 0x7f71b402fbc0 2021-01-27T09:19:02.170 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: Self-signed certificate created 2021-01-27T09:19:02.172 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 msgr2=0x7f71b4032080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:02.173 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 0x7f71b4032080 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f71bc0095f0 tx=0x7f71bc006b30).stop 2021-01-27T09:19:02.173 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 msgr2=0x7f71d406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:02.174 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2898310033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f71c4009fd0 tx=0x7f71c4006ee0).stop 2021-01-27T09:19:02.175 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 shutdown_connections 2021-01-27T09:19:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2898310033 >> v2:172.21.15.103:6800/3303543367 conn(0x7f71b402fbc0 0x7f71b4032080 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 --2- 172.21.15.103:0/2898310033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71d40f9200 0x7f71d406f580 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.167+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 >> 172.21.15.103:0/2898310033 conn(0x7f71d40f4a40 msgr2=0x7f71d40f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.171+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 shutdown_connections 2021-01-27T09:19:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:02.171+0000 7f71d3fff700 1 -- 172.21.15.103:0/2898310033 wait complete. 2021-01-27T09:19:02.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:02 smithi103 bash[9772]: audit 2021-01-27T09:19:02.079690+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:19:02.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:02 smithi103 bash[9772]: audit 2021-01-27T09:19:02.165689+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:02.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:02 smithi103 bash[9772]: audit 2021-01-27T09:19:02.170875+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:02.820 INFO:teuthology.orchestra.run.smithi103.stderr:Creating initial admin user... 2021-01-27T09:19:02.821 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpbx35_99v:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-01-27T09:19:03.955 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4ffff700 1 Processor -- start 2021-01-27T09:19:03.956 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4ffff700 1 -- start start 2021-01-27T09:19:03.956 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:03.956 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4ffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50102a40 con 0x7f7a50073ab0 2021-01-27T09:19:03.956 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:03.957 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49290/0 (socket says 172.21.15.103:49290) 2021-01-27T09:19:03.957 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4effd700 1 -- 172.21.15.103:0/1515995928 learned_addr learned my addr 172.21.15.103:0/1515995928 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:03.958 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4effd700 1 -- 172.21.15.103:0/1515995928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50102b80 con 0x7f7a50073ab0 2021-01-27T09:19:03.958 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.951+0000 7f7a4effd700 1 --2- 172.21.15.103:0/1515995928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7a4000b950 tx=0x7f7a40006ee0).ready entity=mon.0 client_cookie=9dc71e7b802a6f95 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:03.958 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4dffb700 1 -- 172.21.15.103:0/1515995928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a40009840 con 0x7f7a50073ab0 2021-01-27T09:19:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4dffb700 1 -- 172.21.15.103:0/1515995928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7a40009e00 con 0x7f7a50073ab0 2021-01-27T09:19:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4dffb700 1 -- 172.21.15.103:0/1515995928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a40011c80 con 0x7f7a50073ab0 2021-01-27T09:19:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/1515995928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 msgr2=0x7f7a50102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/1515995928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7a4000b950 tx=0x7f7a40006ee0).stop 2021-01-27T09:19:03.960 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/1515995928 shutdown_connections 2021-01-27T09:19:03.960 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/1515995928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a50102550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/1515995928 >> 172.21.15.103:0/1515995928 conn(0x7f7a5006ea50 msgr2=0x7f7a50070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/1515995928 shutdown_connections 2021-01-27T09:19:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/1515995928 wait complete. 2021-01-27T09:19:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 Processor -- start 2021-01-27T09:19:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- start start 2021-01-27T09:19:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5010e480 con 0x7f7a50073ab0 2021-01-27T09:19:03.963 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:03.963 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49292/0 (socket says 172.21.15.103:49292) 2021-01-27T09:19:03.963 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4effd700 1 -- 172.21.15.103:0/191483526 learned_addr learned my addr 172.21.15.103:0/191483526 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:03.963 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4effd700 1 -- 172.21.15.103:0/191483526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5010e5c0 con 0x7f7a50073ab0 2021-01-27T09:19:03.964 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4effd700 1 --2- 172.21.15.103:0/191483526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7a40009420 tx=0x7f7a40006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:03.964 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a40009ca0 con 0x7f7a50073ab0 2021-01-27T09:19:03.965 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7a40011400 con 0x7f7a50073ab0 2021-01-27T09:19:03.965 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4001bbf0 con 0x7f7a50073ab0 2021-01-27T09:19:03.965 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.955+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5010e810 con 0x7f7a50073ab0 2021-01-27T09:19:03.965 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5010f370 con 0x7f7a50073ab0 2021-01-27T09:19:03.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f7a4002b070 con 0x7f7a50073ab0 2021-01-27T09:19:03.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a477fe700 1 --2- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 0x7f7a30032080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:03.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f7a40041910 con 0x7f7a50073ab0 2021-01-27T09:19:03.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a4e7fc700 1 --2- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 0x7f7a30032080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:03.966 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a4e7fc700 1 --2- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 0x7f7a30032080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7a380096a0 tx=0x7f7a38006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:03.967 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.959+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a500581f0 con 0x7f7a50073ab0 2021-01-27T09:19:03.969 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:03.967+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f7a40016020 con 0x7f7a50073ab0 2021-01-27T09:19:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.207+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f7a4000f070 con 0x7f7a50073ab0 2021-01-27T09:19:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.287+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7a50058010 con 0x7f7a3002fbc0 2021-01-27T09:19:04.534 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.531+0000 7f7a477fe700 1 -- 172.21.15.103:0/191483526 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f7a50058010 con 0x7f7a3002fbc0 2021-01-27T09:19:04.535 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$f1NUQyf/C6V0gPerLi28oe.IH1U5M55Fa48FghoPJdCXm2aRe4EwC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1611739144, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-01-27T09:19:04.537 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 msgr2=0x7f7a30032080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:04.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 0x7f7a30032080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7a380096a0 tx=0x7f7a38006b40).stop 2021-01-27T09:19:04.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 msgr2=0x7f7a5010df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:04.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/191483526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7a40009420 tx=0x7f7a40006ee0).stop 2021-01-27T09:19:04.538 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 shutdown_connections 2021-01-27T09:19:04.539 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/191483526 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7a3002fbc0 0x7f7a30032080 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:04.539 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 --2- 172.21.15.103:0/191483526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a50073ab0 0x7f7a5010df90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:04.539 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 >> 172.21.15.103:0/191483526 conn(0x7f7a5006ea50 msgr2=0x7f7a50070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:04.540 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 shutdown_connections 2021-01-27T09:19:04.540 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:04.535+0000 7f7a4ffff700 1 -- 172.21.15.103:0/191483526 wait complete. 2021-01-27T09:19:05.146 INFO:teuthology.orchestra.run.smithi103.stderr:Fetching dashboard port number... 2021-01-27T09:19:05.146 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi103 -v /var/log/ceph/78337516-6080-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpb7ppn8h4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9ub5dic7:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config get mgr mgr/dashboard/ssl_server_port 2021-01-27T09:19:05.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:05 smithi103 bash[9772]: cluster 2021-01-27T09:19:04.215117+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-01-27T09:19:05.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:05 smithi103 bash[9772]: audit 2021-01-27T09:19:04.291721+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:19:05.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:05 smithi103 bash[9772]: audit 2021-01-27T09:19:04.535766+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 Processor -- start 2021-01-27T09:19:06.219 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- start start 2021-01-27T09:19:06.219 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:06.220 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40fbd10 con 0x7f4ae40fb400 2021-01-27T09:19:06.220 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:06.220 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49296/0 (socket says 172.21.15.103:49296) 2021-01-27T09:19:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae3fff700 1 -- 172.21.15.103:0/3278168898 learned_addr learned my addr 172.21.15.103:0/3278168898 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae3fff700 1 -- 172.21.15.103:0/3278168898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40fbe50 con 0x7f4ae40fb400 2021-01-27T09:19:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae3fff700 1 --2- 172.21.15.103:0/3278168898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4ad400b950 tx=0x7f4ad4006ee0).ready entity=mon.0 client_cookie=9143a6e39bf708cf server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae2ffd700 1 -- 172.21.15.103:0/3278168898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4009840 con 0x7f4ae40fb400 2021-01-27T09:19:06.224 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae2ffd700 1 -- 172.21.15.103:0/3278168898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4ad4009e00 con 0x7f4ae40fb400 2021-01-27T09:19:06.224 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae2ffd700 1 -- 172.21.15.103:0/3278168898 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4011c80 con 0x7f4ae40fb400 2021-01-27T09:19:06.224 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- 172.21.15.103:0/3278168898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 msgr2=0x7f4ae40fb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:06.224 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 --2- 172.21.15.103:0/3278168898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4ad400b950 tx=0x7f4ad4006ee0).stop 2021-01-27T09:19:06.224 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- 172.21.15.103:0/3278168898 shutdown_connections 2021-01-27T09:19:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 --2- 172.21.15.103:0/3278168898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae40fb820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- 172.21.15.103:0/3278168898 >> 172.21.15.103:0/3278168898 conn(0x7f4ae406ead0 msgr2=0x7f4ae406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.215+0000 7f4ae9790700 1 -- 172.21.15.103:0/3278168898 shutdown_connections 2021-01-27T09:19:06.225 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 -- 172.21.15.103:0/3278168898 wait complete. 2021-01-27T09:19:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 Processor -- start 2021-01-27T09:19:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 -- start start 2021-01-27T09:19:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4109f60 con 0x7f4ae40fb400 2021-01-27T09:19:06.227 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:06.227 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49298/0 (socket says 172.21.15.103:49298) 2021-01-27T09:19:06.227 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae3fff700 1 -- 172.21.15.103:0/105113288 learned_addr learned my addr 172.21.15.103:0/105113288 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:06.227 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae3fff700 1 -- 172.21.15.103:0/105113288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae410a0a0 con 0x7f4ae40fb400 2021-01-27T09:19:06.228 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae3fff700 1 --2- 172.21.15.103:0/105113288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4ad4009fd0 tx=0x7f4ad4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:06.228 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4009ca0 con 0x7f4ae40fb400 2021-01-27T09:19:06.228 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4ad4011400 con 0x7f4ae40fb400 2021-01-27T09:19:06.228 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae410a2f0 con 0x7f4ae40fb400 2021-01-27T09:19:06.229 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad401bc00 con 0x7f4ae40fb400 2021-01-27T09:19:06.229 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.219+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae410ae50 con 0x7f4ae40fb400 2021-01-27T09:19:06.230 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f4ad402b070 con 0x7f4ae40fb400 2021-01-27T09:19:06.230 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae40581f0 con 0x7f4ae40fb400 2021-01-27T09:19:06.230 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae0ff9700 1 --2- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 0x7f4ac8032130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:06.231 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f4ad4041a40 con 0x7f4ae40fb400 2021-01-27T09:19:06.231 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae37fe700 1 --2- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 0x7f4ac8032130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:06.231 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.223+0000 7f4ae37fe700 1 --2- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 0x7f4ac8032130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4acc0089e0 tx=0x7f4acc006ec0).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:06.232 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.227+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f4ad4022d50 con 0x7f4ae40fb400 2021-01-27T09:19:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.511+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f4ae4044bc0 con 0x7f4ae40fb400 2021-01-27T09:19:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.511+0000 7f4ae0ff9700 1 -- 172.21.15.103:0/105113288 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f4ad4016070 con 0x7f4ae40fb400 2021-01-27T09:19:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 8443 2021-01-27T09:19:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 msgr2=0x7f4ac8032130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 --2- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 0x7f4ac8032130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4acc0089e0 tx=0x7f4acc006ec0).stop 2021-01-27T09:19:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 msgr2=0x7f4ae4109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 --2- 172.21.15.103:0/105113288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4ad4009fd0 tx=0x7f4ad4006ee0).stop 2021-01-27T09:19:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 shutdown_connections 2021-01-27T09:19:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 --2- 172.21.15.103:0/105113288 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4ac802fc70 0x7f4ac8032130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 --2- 172.21.15.103:0/105113288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae40fb400 0x7f4ae4109a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 >> 172.21.15.103:0/105113288 conn(0x7f4ae406ead0 msgr2=0x7f4ae40f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 shutdown_connections 2021-01-27T09:19:06.522 INFO:teuthology.orchestra.run.smithi103.stderr:/usr/bin/ceph: 2021-01-27T09:19:06.515+0000 7f4ae9790700 1 -- 172.21.15.103:0/105113288 wait complete. 2021-01-27T09:19:06.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:06 smithi103 bash[9772]: audit 2021-01-27T09:19:06.517513+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.103:0/105113288' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-01-27T09:19:07.086 INFO:teuthology.orchestra.run.smithi103.stderr:firewalld does not appear to be present 2021-01-27T09:19:07.086 INFO:teuthology.orchestra.run.smithi103.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-01-27T09:19:07.090 INFO:teuthology.orchestra.run.smithi103.stderr:Ceph Dashboard is now available at: 2021-01-27T09:19:07.090 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.090 INFO:teuthology.orchestra.run.smithi103.stderr: URL: https://smithi103.front.sepia.ceph.com:8443/ 2021-01-27T09:19:07.090 INFO:teuthology.orchestra.run.smithi103.stderr: User: admin 2021-01-27T09:19:07.091 INFO:teuthology.orchestra.run.smithi103.stderr: Password: xtsf8bdok8 2021-01-27T09:19:07.091 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.092 INFO:teuthology.orchestra.run.smithi103.stderr:You can access the Ceph CLI with: 2021-01-27T09:19:07.092 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.092 INFO:teuthology.orchestra.run.smithi103.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-01-27T09:19:07.092 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.092 INFO:teuthology.orchestra.run.smithi103.stderr:Please consider enabling telemetry to help improve Ceph: 2021-01-27T09:19:07.093 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.093 INFO:teuthology.orchestra.run.smithi103.stderr: ceph telemetry on 2021-01-27T09:19:07.093 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.093 INFO:teuthology.orchestra.run.smithi103.stderr:For more information see: 2021-01-27T09:19:07.093 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.094 INFO:teuthology.orchestra.run.smithi103.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-01-27T09:19:07.094 INFO:teuthology.orchestra.run.smithi103.stderr: 2021-01-27T09:19:07.094 INFO:teuthology.orchestra.run.smithi103.stderr:Bootstrap complete. 2021-01-27T09:19:07.094 INFO:teuthology.orchestra.run.smithi103.stderr:Releasing lock 139856204062528 on /run/cephadm/78337516-6080-11eb-8f9a-001a4aab830c.lock 2021-01-27T09:19:07.095 INFO:teuthology.orchestra.run.smithi103.stderr:Lock 139856204062528 released on /run/cephadm/78337516-6080-11eb-8f9a-001a4aab830c.lock 2021-01-27T09:19:07.125 INFO:tasks.cephadm:Fetching config... 2021-01-27T09:19:07.126 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:19:07.126 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-01-27T09:19:07.132 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-01-27T09:19:07.133 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:19:07.133 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-01-27T09:19:07.139 INFO:tasks.cephadm:Fetching mon keyring... 2021-01-27T09:19:07.139 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:19:07.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-01-27T09:19:07.191 INFO:tasks.cephadm:Fetching pub ssh key... 2021-01-27T09:19:07.192 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:19:07.192 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-01-27T09:19:07.197 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-01-27T09:19:07.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBi5yE43/46TS6awZlge9jCWp+fVQu2ZuGmiduF6N5RQ1Hs1GJmbOPM7weuYhTKlbBg0wyAUVJR8qTPeaeDnZ884m3JieMjHRI9Z8yYPKIrq/9i4dVe28qyWFtRPyfl4YMQTiP56yAjQwwMvCPr4Zy2D1MXR9XG6I1NV4SZlRhDP0iDeQmRbafp590GiCGeSKlxICrJZofft9kQuPVZ6ecY99sJw9fYpD73Zi4csmbuq9cPVPl7DVgCs3+QFalQNv51OI2l4zJnAXbnkbndFVOjSgNZS0MiQp+WUmBGO7+YhwXRcIk985wCj5H1URnnic2oTODaU2Pm5q6uFEWAAOERES0QT3MZW2w0R/TNRWekpMiDdNGeojEqqTuiPcPu6dQUBgLFrmUl91p63WH6KzjGfYJRUT9tXtS/2eDYUyyTnykrmHmXOtGwlwhFtk8n+T8a0YbhrO3LXOWtyFbJHG3VMI9n9/76V//UZgtGRaf9jUdEpc3PuKMw4fiw3JJT6U= ceph-78337516-6080-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T09:19:07.227 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBi5yE43/46TS6awZlge9jCWp+fVQu2ZuGmiduF6N5RQ1Hs1GJmbOPM7weuYhTKlbBg0wyAUVJR8qTPeaeDnZ884m3JieMjHRI9Z8yYPKIrq/9i4dVe28qyWFtRPyfl4YMQTiP56yAjQwwMvCPr4Zy2D1MXR9XG6I1NV4SZlRhDP0iDeQmRbafp590GiCGeSKlxICrJZofft9kQuPVZ6ecY99sJw9fYpD73Zi4csmbuq9cPVPl7DVgCs3+QFalQNv51OI2l4zJnAXbnkbndFVOjSgNZS0MiQp+WUmBGO7+YhwXRcIk985wCj5H1URnnic2oTODaU2Pm5q6uFEWAAOERES0QT3MZW2w0R/TNRWekpMiDdNGeojEqqTuiPcPu6dQUBgLFrmUl91p63WH6KzjGfYJRUT9tXtS/2eDYUyyTnykrmHmXOtGwlwhFtk8n+T8a0YbhrO3LXOWtyFbJHG3VMI9n9/76V//UZgtGRaf9jUdEpc3PuKMw4fiw3JJT6U= ceph-78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:19:07.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBi5yE43/46TS6awZlge9jCWp+fVQu2ZuGmiduF6N5RQ1Hs1GJmbOPM7weuYhTKlbBg0wyAUVJR8qTPeaeDnZ884m3JieMjHRI9Z8yYPKIrq/9i4dVe28qyWFtRPyfl4YMQTiP56yAjQwwMvCPr4Zy2D1MXR9XG6I1NV4SZlRhDP0iDeQmRbafp590GiCGeSKlxICrJZofft9kQuPVZ6ecY99sJw9fYpD73Zi4csmbuq9cPVPl7DVgCs3+QFalQNv51OI2l4zJnAXbnkbndFVOjSgNZS0MiQp+WUmBGO7+YhwXRcIk985wCj5H1URnnic2oTODaU2Pm5q6uFEWAAOERES0QT3MZW2w0R/TNRWekpMiDdNGeojEqqTuiPcPu6dQUBgLFrmUl91p63WH6KzjGfYJRUT9tXtS/2eDYUyyTnykrmHmXOtGwlwhFtk8n+T8a0YbhrO3LXOWtyFbJHG3VMI9n9/76V//UZgtGRaf9jUdEpc3PuKMw4fiw3JJT6U= ceph-78337516-6080-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T09:19:07.263 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBi5yE43/46TS6awZlge9jCWp+fVQu2ZuGmiduF6N5RQ1Hs1GJmbOPM7weuYhTKlbBg0wyAUVJR8qTPeaeDnZ884m3JieMjHRI9Z8yYPKIrq/9i4dVe28qyWFtRPyfl4YMQTiP56yAjQwwMvCPr4Zy2D1MXR9XG6I1NV4SZlRhDP0iDeQmRbafp590GiCGeSKlxICrJZofft9kQuPVZ6ecY99sJw9fYpD73Zi4csmbuq9cPVPl7DVgCs3+QFalQNv51OI2l4zJnAXbnkbndFVOjSgNZS0MiQp+WUmBGO7+YhwXRcIk985wCj5H1URnnic2oTODaU2Pm5q6uFEWAAOERES0QT3MZW2w0R/TNRWekpMiDdNGeojEqqTuiPcPu6dQUBgLFrmUl91p63WH6KzjGfYJRUT9tXtS/2eDYUyyTnykrmHmXOtGwlwhFtk8n+T8a0YbhrO3LXOWtyFbJHG3VMI9n9/76V//UZgtGRaf9jUdEpc3PuKMw4fiw3JJT6U= ceph-78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:19:07.275 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-01-27T09:19:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.011+0000 7f0dd195f700 1 -- 172.21.15.103:0/4211364048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 msgr2=0x7f0dcc0f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.011+0000 7f0dd195f700 1 --2- 172.21.15.103:0/4211364048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc0f79c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0dc0004d00 tx=0x7f0dc0009b30).stop 2021-01-27T09:19:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- 172.21.15.103:0/4211364048 shutdown_connections 2021-01-27T09:19:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 --2- 172.21.15.103:0/4211364048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc0f79c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- 172.21.15.103:0/4211364048 >> 172.21.15.103:0/4211364048 conn(0x7f0dcc0601c0 msgr2=0x7f0dcc0f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- 172.21.15.103:0/4211364048 shutdown_connections 2021-01-27T09:19:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- 172.21.15.103:0/4211364048 wait complete. 2021-01-27T09:19:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 Processor -- start 2021-01-27T09:19:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- start start 2021-01-27T09:19:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd195f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc106d60 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.020 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd095d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:11.020 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd095d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49304/0 (socket says 172.21.15.103:49304) 2021-01-27T09:19:11.020 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd095d700 1 -- 172.21.15.103:0/220768645 learned_addr learned my addr 172.21.15.103:0/220768645 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:11.020 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd095d700 1 -- 172.21.15.103:0/220768645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc106ea0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.021 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dd095d700 1 --2- 172.21.15.103:0/220768645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0dc0000c00 tx=0x7f0dc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:11.022 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dc000e030 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.022 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.015+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0dc00077b0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.022 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc1070f0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.022 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dc0018070 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.023 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc107c50 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.023 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f0dc001d7f0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.023 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dc97fa700 1 --2- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 0x7f0dbc0321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:11.024 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f0dc00421d0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.024 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dcbfff700 1 --2- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 0x7f0dbc0321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:11.024 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac004da0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.024 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.019+0000 7f0dcbfff700 1 --2- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 0x7f0dbc0321c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0db80096a0 tx=0x7f0db8006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.031+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f0dc001dad0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:10 smithi103 bash[9772]: audit 2021-01-27T09:19:10.845737+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:11.199 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.195+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f0dac0059f0 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.205 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dc97fa700 1 -- 172.21.15.103:0/220768645 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0dc0025b80 con 0x7f0dcc0f75a0 2021-01-27T09:19:11.207 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 msgr2=0x7f0dbc0321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:11.207 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 --2- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 0x7f0dbc0321c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0db80096a0 tx=0x7f0db8006b40).stop 2021-01-27T09:19:11.207 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 msgr2=0x7f0dcc106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:11.208 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 --2- 172.21.15.103:0/220768645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0dc0000c00 tx=0x7f0dc0009b30).stop 2021-01-27T09:19:11.208 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 shutdown_connections 2021-01-27T09:19:11.208 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 --2- 172.21.15.103:0/220768645 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0dbc02fd00 0x7f0dbc0321c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:11.209 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 --2- 172.21.15.103:0/220768645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dcc0f75a0 0x7f0dcc106870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:11.209 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 >> 172.21.15.103:0/220768645 conn(0x7f0dcc0601c0 msgr2=0x7f0dcc0f5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:11.209 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 shutdown_connections 2021-01-27T09:19:11.209 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:11.203+0000 7f0dd195f700 1 -- 172.21.15.103:0/220768645 wait complete. 2021-01-27T09:19:12.095 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi047 2021-01-27T09:19:12.096 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:19:12.096 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.conf 2021-01-27T09:19:12.104 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:19:12.105 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T09:19:12.154 INFO:tasks.cephadm:Adding host smithi047 to orchestrator... 2021-01-27T09:19:12.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch host add smithi047 2021-01-27T09:19:12.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.206982+0000 mon.a (mon.0) 99 : audit [INF] from='client.? 172.21.15.103:0/220768645' entity='client.admin' 2021-01-27T09:19:12.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.209449+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:12.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: cephadm 2021-01-27T09:19:11.210911+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:19:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.605581+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: cephadm 2021-01-27T09:19:11.606065+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-01-27T09:19:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.606530+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:19:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.607733+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:19:12.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: cephadm 2021-01-27T09:19:11.608868+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:19:12.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:12 smithi103 bash[9772]: audit 2021-01-27T09:19:11.610003+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:19:17.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: audit 2021-01-27T09:19:16.348359+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:17.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: cephadm 2021-01-27T09:19:16.349346+0000 mgr.y (mgr.14138) 8 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-01-27T09:19:17.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: audit 2021-01-27T09:19:16.349875+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T09:19:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: audit 2021-01-27T09:19:16.351488+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:19:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: cephadm 2021-01-27T09:19:16.352671+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring daemon mgr.y on smithi103 2021-01-27T09:19:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:17 smithi103 bash[9772]: audit 2021-01-27T09:19:16.353681+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T09:19:19.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:19 smithi103 bash[9772]: cluster 2021-01-27T09:19:18.119329+0000 mgr.y (mgr.14138) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:19.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:19 smithi103 bash[9772]: audit 2021-01-27T09:19:18.303938+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:19.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:19 smithi103 bash[9772]: audit 2021-01-27T09:19:18.307879+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:19.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:19 smithi103 bash[9772]: audit 2021-01-27T09:19:19.013235+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:19.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:19 smithi103 bash[9772]: audit 2021-01-27T09:19:19.018148+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:21.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:21 smithi103 bash[9772]: cluster 2021-01-27T09:19:20.119724+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:23.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:23 smithi103 bash[9772]: cluster 2021-01-27T09:19:22.120197+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:24.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:24 smithi103 bash[9772]: cluster 2021-01-27T09:19:24.120643+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:26.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:26 smithi103 bash[9772]: cluster 2021-01-27T09:19:26.121135+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:28.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:28 smithi103 bash[9772]: cluster 2021-01-27T09:19:28.121568+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:30.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:30 smithi103 bash[9772]: cluster 2021-01-27T09:19:30.122015+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:32.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:32 smithi103 bash[9772]: cluster 2021-01-27T09:19:32.122468+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:34.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:34 smithi103 bash[9772]: cluster 2021-01-27T09:19:34.123091+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:36.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:36 smithi103 bash[9772]: cluster 2021-01-27T09:19:36.123499+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:38 smithi103 bash[9772]: cluster 2021-01-27T09:19:38.123868+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:39.703 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 -- 172.21.15.47:0/2025547386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 msgr2=0x7f81ac0f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:39.703 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 --2- 172.21.15.47:0/2025547386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac0f79c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f819c004d00 tx=0x7f819c009b30).stop 2021-01-27T09:19:39.703 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 -- 172.21.15.47:0/2025547386 shutdown_connections 2021-01-27T09:19:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 --2- 172.21.15.47:0/2025547386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac0f79c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 -- 172.21.15.47:0/2025547386 >> 172.21.15.47:0/2025547386 conn(0x7f81ac0601c0 msgr2=0x7f81ac0f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 -- 172.21.15.47:0/2025547386 shutdown_connections 2021-01-27T09:19:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 -- 172.21.15.47:0/2025547386 wait complete. 2021-01-27T09:19:39.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.700+0000 7f81b08e0700 1 Processor -- start 2021-01-27T09:19:39.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 -- start start 2021-01-27T09:19:39.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:39.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac106d60 con 0x7f81ac0f75a0 2021-01-27T09:19:39.707 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81ab7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:39.707 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81ab7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.47:41822/0 (socket says 172.21.15.47:41822) 2021-01-27T09:19:39.707 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81ab7fe700 1 -- 172.21.15.47:0/4194081464 learned_addr learned my addr 172.21.15.47:0/4194081464 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:19:39.708 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81ab7fe700 1 -- 172.21.15.47:0/4194081464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac106ea0 con 0x7f81ac0f75a0 2021-01-27T09:19:39.708 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81ab7fe700 1 --2- 172.21.15.47:0/4194081464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f819c0096a0 tx=0x7f819c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:39.708 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f819c00e030 con 0x7f81ac0f75a0 2021-01-27T09:19:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac1070f0 con 0x7f81ac0f75a0 2021-01-27T09:19:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f819c0077b0 con 0x7f81ac0f75a0 2021-01-27T09:19:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f819c018070 con 0x7f81ac0f75a0 2021-01-27T09:19:39.709 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac107c50 con 0x7f81ac0f75a0 2021-01-27T09:19:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac0581f0 con 0x7f81ac0f75a0 2021-01-27T09:19:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.704+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f819c01d910 con 0x7f81ac0f75a0 2021-01-27T09:19:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.708+0000 7f81a8ff9700 1 --2- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 0x7f818c0320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.708+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f819c0414c0 con 0x7f81ac0f75a0 2021-01-27T09:19:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.708+0000 7f81a3fff700 1 --2- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 0x7f818c0320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:39.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.708+0000 7f81a3fff700 1 --2- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 0x7f818c0320e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f81940096a0 tx=0x7f8194006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:39.718 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.716+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f819c025d60 con 0x7f81ac0f75a0 2021-01-27T09:19:39.910 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:39.908+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}) v1 -- 0x7f81ac0fc750 con 0x7f818c02fc20 2021-01-27T09:19:40.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:40 smithi103 bash[9772]: audit 2021-01-27T09:19:39.914558+0000 mgr.y (mgr.14138) 21 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:19:40.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:40 smithi103 bash[9772]: cluster 2021-01-27T09:19:40.124402+0000 mgr.y (mgr.14138) 22 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:40.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:19:39 smithi103 bash[10018]: Warning: Permanently added 'smithi047,172.21.15.47' (ECDSA) to the list of known hosts. 2021-01-27T09:19:40.702 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.700+0000 7f81a8ff9700 1 -- 172.21.15.47:0/4194081464 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f81ac0fc750 con 0x7f818c02fc20 2021-01-27T09:19:40.702 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi047' 2021-01-27T09:19:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 msgr2=0x7f818c0320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 --2- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 0x7f818c0320e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f81940096a0 tx=0x7f8194006b40).stop 2021-01-27T09:19:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 msgr2=0x7f81ac106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 --2- 172.21.15.47:0/4194081464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f819c0096a0 tx=0x7f819c009b30).stop 2021-01-27T09:19:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 shutdown_connections 2021-01-27T09:19:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 --2- 172.21.15.47:0/4194081464 >> v2:172.21.15.103:6800/3303543367 conn(0x7f818c02fc20 0x7f818c0320e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 --2- 172.21.15.47:0/4194081464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81ac0f75a0 0x7f81ac106870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 >> 172.21.15.47:0/4194081464 conn(0x7f81ac0601c0 msgr2=0x7f81ac0f5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 shutdown_connections 2021-01-27T09:19:40.712 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:40.704+0000 7f81b08e0700 1 -- 172.21.15.47:0/4194081464 wait complete. 2021-01-27T09:19:41.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch host ls --format=json 2021-01-27T09:19:42.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:40.700100+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:42.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: cephadm 2021-01-27T09:19:40.701093+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi047 2021-01-27T09:19:42.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:40.705236+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:42.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:41.137516+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:42.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:41.141936+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:42.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:41.401517+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:42.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:41.487757+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:42.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:41 smithi103 bash[9772]: audit 2021-01-27T09:19:41.489240+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:19:43.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:42 smithi103 bash[9772]: cluster 2021-01-27T09:19:42.124941+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:44.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:44 smithi103 bash[9772]: cluster 2021-01-27T09:19:44.125383+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:46.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/2440362371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 msgr2=0x7ff7140f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:46.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 --2- 172.21.15.47:0/2440362371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140f4d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff710004d00 tx=0x7ff710009b30).stop 2021-01-27T09:19:46.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/2440362371 shutdown_connections 2021-01-27T09:19:46.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 --2- 172.21.15.47:0/2440362371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140f4d20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:46.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/2440362371 >> 172.21.15.47:0/2440362371 conn(0x7ff7140ef210 msgr2=0x7ff7140f1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:46.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/2440362371 shutdown_connections 2021-01-27T09:19:46.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/2440362371 wait complete. 2021-01-27T09:19:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 Processor -- start 2021-01-27T09:19:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- start start 2021-01-27T09:19:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140f9d40 con 0x7ff7140f4900 2021-01-27T09:19:46.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff718e79700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:46.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff718e79700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.47:41828/0 (socket says 172.21.15.47:41828) 2021-01-27T09:19:46.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff718e79700 1 -- 172.21.15.47:0/72189179 learned_addr learned my addr 172.21.15.47:0/72189179 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:19:46.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff718e79700 1 -- 172.21.15.47:0/72189179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140f9e80 con 0x7ff7140f4900 2021-01-27T09:19:46.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff718e79700 1 --2- 172.21.15.47:0/72189179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff710007ed0 tx=0x7ff710009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:46.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff71000e030 con 0x7ff7140f4900 2021-01-27T09:19:46.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140fa070 con 0x7ff7140f4900 2021-01-27T09:19:46.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7140fa480 con 0x7ff7140f4900 2021-01-27T09:19:46.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff710013a80 con 0x7ff7140f4900 2021-01-27T09:19:46.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.144+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff710018070 con 0x7ff7140f4900 2021-01-27T09:19:46.150 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7ff71001d960 con 0x7ff7140f4900 2021-01-27T09:19:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff7097fa700 1 --2- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 0x7ff6fc0320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7ff710013620 con 0x7ff7140f4900 2021-01-27T09:19:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7140581f0 con 0x7ff7140f4900 2021-01-27T09:19:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff70bfff700 1 --2- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 0x7ff6fc0320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.148+0000 7ff70bfff700 1 --2- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 0x7ff6fc0320e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff7040096a0 tx=0x7ff704006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:46.158 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.156+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ff71001b370 con 0x7ff7140f4900 2021-01-27T09:19:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.348+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7140fac20 con 0x7ff6fc02fc20 2021-01-27T09:19:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff7097fa700 1 -- 172.21.15.47:0/72189179 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+153 (secure 0 0 0) 0x7ff7140fac20 con 0x7ff6fc02fc20 2021-01-27T09:19:46.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2021-01-27T09:19:46.354 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "smithi103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "smithi047", "hostname": "smithi047", "labels": [], "status": ""}] 2021-01-27T09:19:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 msgr2=0x7ff6fc0320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 --2- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 0x7ff6fc0320e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff7040096a0 tx=0x7ff704006b40).stop 2021-01-27T09:19:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 msgr2=0x7ff7140fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 --2- 172.21.15.47:0/72189179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff710007ed0 tx=0x7ff710009b30).stop 2021-01-27T09:19:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 shutdown_connections 2021-01-27T09:19:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 --2- 172.21.15.47:0/72189179 >> v2:172.21.15.103:6800/3303543367 conn(0x7ff6fc02fc20 0x7ff6fc0320e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 --2- 172.21.15.47:0/72189179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7140f4900 0x7ff7140fb8c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 >> 172.21.15.47:0/72189179 conn(0x7ff7140ef210 msgr2=0x7ff7140f15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 shutdown_connections 2021-01-27T09:19:46.357 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:19:46.352+0000 7ff719e7b700 1 -- 172.21.15.47:0/72189179 wait complete. 2021-01-27T09:19:46.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:46 smithi103 bash[9772]: cluster 2021-01-27T09:19:46.125804+0000 mgr.y (mgr.14138) 26 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:47.135 INFO:tasks.cephadm:Setting crush tunables to default 2021-01-27T09:19:47.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd crush tunables default 2021-01-27T09:19:47.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:47 smithi103 bash[9772]: audit 2021-01-27T09:19:46.353836+0000 mgr.y (mgr.14138) 27 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:19:48.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:48 smithi103 bash[9772]: cluster 2021-01-27T09:19:48.126277+0000 mgr.y (mgr.14138) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:48.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:48 smithi103 bash[9772]: audit 2021-01-27T09:19:48.134483+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:49.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:49 smithi103 bash[9772]: audit 2021-01-27T09:19:48.506170+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:49.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:49 smithi103 bash[9772]: cephadm 2021-01-27T09:19:48.507098+0000 mgr.y (mgr.14138) 29 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:19:49.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:49 smithi103 bash[9772]: audit 2021-01-27T09:19:48.970491+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:49.823 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:49 smithi103 bash[9772]: audit 2021-01-27T09:19:48.976217+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:49.949 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- 172.21.15.103:0/2268249632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 msgr2=0x7fdab80f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:49.949 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 --2- 172.21.15.103:0/2268249632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab80f79c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fdab0004d00 tx=0x7fdab0009b30).stop 2021-01-27T09:19:49.949 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- 172.21.15.103:0/2268249632 shutdown_connections 2021-01-27T09:19:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 --2- 172.21.15.103:0/2268249632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab80f79c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- 172.21.15.103:0/2268249632 >> 172.21.15.103:0/2268249632 conn(0x7fdab80601c0 msgr2=0x7fdab80f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- 172.21.15.103:0/2268249632 shutdown_connections 2021-01-27T09:19:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- 172.21.15.103:0/2268249632 wait complete. 2021-01-27T09:19:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 Processor -- start 2021-01-27T09:19:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- start start 2021-01-27T09:19:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabdc92700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8106d60 con 0x7fdab80f75a0 2021-01-27T09:19:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabcc90700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabcc90700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49312/0 (socket says 172.21.15.103:49312) 2021-01-27T09:19:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabcc90700 1 -- 172.21.15.103:0/3638840188 learned_addr learned my addr 172.21.15.103:0/3638840188 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabcc90700 1 -- 172.21.15.103:0/3638840188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8106ea0 con 0x7fdab80f75a0 2021-01-27T09:19:49.954 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdabcc90700 1 --2- 172.21.15.103:0/3638840188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdab00096a0 tx=0x7fdab0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:49.954 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.947+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdab000e030 con 0x7fdab80f75a0 2021-01-27T09:19:49.954 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fdab00077b0 con 0x7fdab80f75a0 2021-01-27T09:19:49.954 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab81070f0 con 0x7fdab80f75a0 2021-01-27T09:19:49.954 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdab0018070 con 0x7fdab80f75a0 2021-01-27T09:19:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8107c50 con 0x7fdab80f75a0 2021-01-27T09:19:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fdab001d860 con 0x7fdab80f75a0 2021-01-27T09:19:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab80581f0 con 0x7fdab80f75a0 2021-01-27T09:19:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab57fa700 1 --2- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 0x7fda98032130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7fdab0041920 con 0x7fdab80f75a0 2021-01-27T09:19:49.957 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab7fff700 1 --2- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 0x7fda98032130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:49.957 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.951+0000 7fdab7fff700 1 --2- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 0x7fda98032130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdaa00096a0 tx=0x7fdaa0006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:49.958 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:49.955+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fdab001db80 con 0x7fdab80f75a0 2021-01-27T09:19:50.126 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.123+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdab80fc6e0 con 0x7fdab80f75a0 2021-01-27T09:19:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.511+0000 7fdab57fa700 1 -- 172.21.15.103:0/3638840188 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdab0025b80 con 0x7fdab80f75a0 2021-01-27T09:19:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 msgr2=0x7fda98032130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 --2- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 0x7fda98032130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdaa00096a0 tx=0x7fdaa0006b40).stop 2021-01-27T09:19:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 msgr2=0x7fdab8106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 --2- 172.21.15.103:0/3638840188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdab00096a0 tx=0x7fdab0009b30).stop 2021-01-27T09:19:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 shutdown_connections 2021-01-27T09:19:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 --2- 172.21.15.103:0/3638840188 >> v2:172.21.15.103:6800/3303543367 conn(0x7fda9802fc70 0x7fda98032130 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 --2- 172.21.15.103:0/3638840188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab80f75a0 0x7fdab8106870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 >> 172.21.15.103:0/3638840188 conn(0x7fdab80601c0 msgr2=0x7fdab80f5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 shutdown_connections 2021-01-27T09:19:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:50.515+0000 7fdabdc92700 1 -- 172.21.15.103:0/3638840188 wait complete. 2021-01-27T09:19:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2021-01-27T09:19:50.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:50 smithi103 bash[9772]: cluster 2021-01-27T09:19:50.126636+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:50.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:50 smithi103 bash[9772]: audit 2021-01-27T09:19:50.129052+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.103:0/3638840188' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-01-27T09:19:51.183 INFO:tasks.cephadm:Adding mon.c on smithi103 2021-01-27T09:19:51.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon 'smithi103:[v2:172.21.15.103:3301,v1:172.21.15.103:6790]=c' 2021-01-27T09:19:51.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:51 smithi103 bash[9772]: audit 2021-01-27T09:19:50.515601+0000 mon.a (mon.0) 125 : audit [INF] from='client.? 172.21.15.103:0/3638840188' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-01-27T09:19:51.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:51 smithi103 bash[9772]: cluster 2021-01-27T09:19:50.515767+0000 mon.a (mon.0) 126 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-01-27T09:19:51.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:51 smithi103 bash[9772]: audit 2021-01-27T09:19:50.516589+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-01-27T09:19:52.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:52 smithi103 bash[9772]: audit 2021-01-27T09:19:51.523006+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-01-27T09:19:52.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:52 smithi103 bash[9772]: cluster 2021-01-27T09:19:51.523156+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-01-27T09:19:52.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:52 smithi103 bash[9772]: audit 2021-01-27T09:19:51.524569+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-01-27T09:19:52.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:52 smithi103 bash[9772]: cluster 2021-01-27T09:19:52.127099+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:53.885 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:53 smithi103 bash[9772]: audit 2021-01-27T09:19:52.524682+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-01-27T09:19:53.885 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:53 smithi103 bash[9772]: cluster 2021-01-27T09:19:52.524867+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:19:54.104 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- 172.21.15.103:0/1177402691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 msgr2=0x7f378c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 --2- 172.21.15.103:0/1177402691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c0f57b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3780004d00 tx=0x7f3780009b30).stop 2021-01-27T09:19:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- 172.21.15.103:0/1177402691 shutdown_connections 2021-01-27T09:19:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 --2- 172.21.15.103:0/1177402691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c0f57b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- 172.21.15.103:0/1177402691 >> 172.21.15.103:0/1177402691 conn(0x7f378c0f0bb0 msgr2=0x7f378c0f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:54.107 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- 172.21.15.103:0/1177402691 shutdown_connections 2021-01-27T09:19:54.107 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- 172.21.15.103:0/1177402691 wait complete. 2021-01-27T09:19:54.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 Processor -- start 2021-01-27T09:19:54.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- start start 2021-01-27T09:19:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3790f21700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c104b70 con 0x7f378c0f5390 2021-01-27T09:19:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f378b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:54.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f378b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49318/0 (socket says 172.21.15.103:49318) 2021-01-27T09:19:54.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f378b7fe700 1 -- 172.21.15.103:0/4146251547 learned_addr learned my addr 172.21.15.103:0/4146251547 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:19:54.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f378b7fe700 1 -- 172.21.15.103:0/4146251547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c104cb0 con 0x7f378c0f5390 2021-01-27T09:19:54.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f378b7fe700 1 --2- 172.21.15.103:0/4146251547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3780000c00 tx=0x7f3780009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:54.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.103+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378000e030 con 0x7f378c0f5390 2021-01-27T09:19:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f37800077b0 con 0x7f378c0f5390 2021-01-27T09:19:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c104f00 con 0x7f378c0f5390 2021-01-27T09:19:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3780018070 con 0x7f378c0f5390 2021-01-27T09:19:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c105a60 con 0x7f378c0f5390 2021-01-27T09:19:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f3780013620 con 0x7f378c0f5390 2021-01-27T09:19:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c0581f0 con 0x7f378c0f5390 2021-01-27T09:19:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3773fff700 1 --2- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 0x7f37740321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:19:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f37800415b0 con 0x7f378c0f5390 2021-01-27T09:19:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f378affd700 1 --2- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 0x7f37740321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:19:54.116 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.107+0000 7f378affd700 1 --2- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 0x7f37740321c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f377c0096a0 tx=0x7f377c006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:19:54.116 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.115+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f37800138b0 con 0x7f378c0f5390 2021-01-27T09:19:54.307 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:54.307+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi103:[v2:172.21.15.103:3301,v1:172.21.15.103:6790]=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f378c0fa5f0 con 0x7f377402fd00 2021-01-27T09:19:54.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:54 smithi103 bash[9772]: cluster 2021-01-27T09:19:54.127455+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:54.927 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:54 smithi103 bash[9772]: audit 2021-01-27T09:19:54.315231+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:19:54.927 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:54 smithi103 bash[9772]: audit 2021-01-27T09:19:54.316683+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:19:54.927 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:54 smithi103 bash[9772]: audit 2021-01-27T09:19:54.318553+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T09:19:55.843 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:55 smithi103 bash[9772]: audit 2021-01-27T09:19:54.310984+0000 mgr.y (mgr.14138) 33 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi103:[v2:172.21.15.103:3301,v1:172.21.15.103:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:19:55.844 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:55 smithi103 bash[9772]: cephadm 2021-01-27T09:19:54.317778+0000 mgr.y (mgr.14138) 34 : cephadm [INF] Deploying daemon mon.c on smithi103 2021-01-27T09:19:56.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:56 smithi103 bash[9772]: cluster 2021-01-27T09:19:56.127911+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:58.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:58 smithi103 bash[9772]: cluster 2021-01-27T09:19:58.128327+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:19:58.514 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.511+0000 7f3773fff700 1 -- 172.21.15.103:0/4146251547 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f378c0fa5f0 con 0x7f377402fd00 2021-01-27T09:19:58.515 INFO:teuthology.orchestra.run.smithi103.stdout:Deployed mon.c on host 'smithi103' 2021-01-27T09:19:58.517 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 msgr2=0x7f37740321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:58.517 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 --2- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 0x7f37740321c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f377c0096a0 tx=0x7f377c006b40).stop 2021-01-27T09:19:58.518 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 msgr2=0x7f378c104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:19:58.518 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 --2- 172.21.15.103:0/4146251547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3780000c00 tx=0x7f3780009b30).stop 2021-01-27T09:19:58.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 shutdown_connections 2021-01-27T09:19:58.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 --2- 172.21.15.103:0/4146251547 >> v2:172.21.15.103:6800/3303543367 conn(0x7f377402fd00 0x7f37740321c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:58.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 --2- 172.21.15.103:0/4146251547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378c0f5390 0x7f378c104680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:19:58.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 >> 172.21.15.103:0/4146251547 conn(0x7f378c0f0bb0 msgr2=0x7f378c0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:19:58.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 shutdown_connections 2021-01-27T09:19:58.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:19:58.515+0000 7f3790f21700 1 -- 172.21.15.103:0/4146251547 wait complete. 2021-01-27T09:19:59.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:59 smithi103 bash[9772]: audit 2021-01-27T09:19:58.317962+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:19:59.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:59 smithi103 bash[9772]: audit 2021-01-27T09:19:58.319695+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:19:59.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:59 smithi103 bash[9772]: audit 2021-01-27T09:19:58.514488+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:19:59.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:19:59 smithi103 bash[9772]: audit 2021-01-27T09:19:58.516216+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:19:59.736 DEBUG:teuthology.orchestra.run.smithi103:mon.c> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.c.service 2021-01-27T09:19:59.740 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-01-27T09:19:59.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T09:19:59.823 INFO:journalctl@ceph.mon.c.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:20:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[9772]: audit 2021-01-27T09:19:59.295204+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[9772]: audit 2021-01-27T09:19:59.300846+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:00.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[9772]: cluster 2021-01-27T09:20:00.128844+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:00.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.455+0000 7f40edaed700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T09:20:00.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.455+0000 7f40edaed700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T09:20:00.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.455+0000 7f40edaed700 0 pidfile_write: ignore empty --pid-file 2021-01-27T09:20:00.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.459+0000 7f40edaed700 0 load: jerasure load: lrc load: isa 2021-01-27T09:20:00.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T09:20:00.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T09:20:00.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T09:20:00.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: DB SUMMARY 2021-01-27T09:20:00.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T09:20:00.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T09:20:00.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T09:20:00.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-01-27T09:20:00.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-01-27T09:20:00.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T09:20:00.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T09:20:00.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T09:20:00.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.env: 0x55f5db6201c0 2021-01-27T09:20:00.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.fs: Posix File System 2021-01-27T09:20:00.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.info_log: 0x55f5dd8e3e80 2021-01-27T09:20:00.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T09:20:00.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.statistics: (nil) 2021-01-27T09:20:00.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.use_fsync: 0 2021-01-27T09:20:00.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T09:20:00.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T09:20:00.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T09:20:00.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T09:20:00.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T09:20:00.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T09:20:00.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T09:20:00.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T09:20:00.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T09:20:00.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T09:20:00.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T09:20:00.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.db_log_dir: 2021-01-27T09:20:00.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-01-27T09:20:00.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T09:20:00.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T09:20:00.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T09:20:00.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T09:20:00.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T09:20:00.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T09:20:00.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T09:20:00.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T09:20:00.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T09:20:00.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T09:20:00.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.write_buffer_manager: 0x55f5dd93dc20 2021-01-27T09:20:00.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T09:20:00.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T09:20:00.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T09:20:00.655 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T09:20:00.655 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T09:20:00.655 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T09:20:00.655 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T09:20:00.655 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T09:20:00.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T09:20:00.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.unordered_write: 0 2021-01-27T09:20:00.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T09:20:00.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T09:20:00.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T09:20:00.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T09:20:00.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.row_cache: None 2021-01-27T09:20:00.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.wal_filter: None 2021-01-27T09:20:00.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T09:20:00.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T09:20:00.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T09:20:00.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T09:20:00.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T09:20:00.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T09:20:00.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T09:20:00.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T09:20:00.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T09:20:00.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T09:20:00.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T09:20:00.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T09:20:00.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T09:20:00.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T09:20:00.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T09:20:00.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T09:20:00.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T09:20:00.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T09:20:00.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T09:20:00.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T09:20:00.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T09:20:00.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_open_files: -1 2021-01-27T09:20:00.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T09:20:00.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T09:20:00.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T09:20:00.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T09:20:00.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Compression algorithms supported: 2021-01-27T09:20:00.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T09:20:00.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kZSTD supported: 0 2021-01-27T09:20:00.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T09:20:00.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T09:20:00.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T09:20:00.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T09:20:00.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T09:20:00.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T09:20:00.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T09:20:00.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-01-27T09:20:00.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T09:20:00.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T09:20:00.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.merge_operator: 2021-01-27T09:20:00.668 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_filter: None 2021-01-27T09:20:00.668 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T09:20:00.668 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T09:20:00.668 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T09:20:00.668 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f5dd88c1e0) 2021-01-27T09:20:00.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: cache_index_and_filter_blocks: 1 2021-01-27T09:20:00.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T09:20:00.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T09:20:00.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: pin_top_level_index_and_filter: 1 2021-01-27T09:20:00.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: index_type: 0 2021-01-27T09:20:00.670 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: data_block_index_type: 0 2021-01-27T09:20:00.670 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: index_shortening: 1 2021-01-27T09:20:00.670 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T09:20:00.670 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: hash_index_allow_collision: 1 2021-01-27T09:20:00.670 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: checksum: 1 2021-01-27T09:20:00.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: no_block_cache: 0 2021-01-27T09:20:00.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_cache: 0x55f5dd8c4510 2021-01-27T09:20:00.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_cache_name: BinnedLRUCache 2021-01-27T09:20:00.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_cache_options: 2021-01-27T09:20:00.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: capacity : 536870912 2021-01-27T09:20:00.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: num_shard_bits : 4 2021-01-27T09:20:00.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: strict_capacity_limit : 0 2021-01-27T09:20:00.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: high_pri_pool_ratio: 0.000 2021-01-27T09:20:00.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_cache_compressed: (nil) 2021-01-27T09:20:00.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: persistent_cache: (nil) 2021-01-27T09:20:00.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_size: 4096 2021-01-27T09:20:00.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_size_deviation: 10 2021-01-27T09:20:00.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_restart_interval: 16 2021-01-27T09:20:00.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: index_block_restart_interval: 1 2021-01-27T09:20:00.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: metadata_block_size: 4096 2021-01-27T09:20:00.674 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: partition_filters: 0 2021-01-27T09:20:00.674 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: use_delta_encoding: 1 2021-01-27T09:20:00.674 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T09:20:00.674 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: whole_key_filtering: 1 2021-01-27T09:20:00.674 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: verify_compression: 0 2021-01-27T09:20:00.675 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: read_amp_bytes_per_bit: 0 2021-01-27T09:20:00.675 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: format_version: 2 2021-01-27T09:20:00.675 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: enable_index_compression: 1 2021-01-27T09:20:00.675 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: block_align: 0 2021-01-27T09:20:00.675 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T09:20:00.676 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T09:20:00.676 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression: NoCompression 2021-01-27T09:20:00.676 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T09:20:00.676 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T09:20:00.676 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T09:20:00.677 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.num_levels: 7 2021-01-27T09:20:00.677 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T09:20:00.677 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T09:20:00.677 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T09:20:00.677 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T09:20:00.678 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T09:20:00.678 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T09:20:00.678 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T09:20:00.678 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:20:00.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T09:20:00.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T09:20:00.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T09:20:00.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T09:20:00.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T09:20:00.680 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:20:00.680 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T09:20:00.680 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T09:20:00.680 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T09:20:00.680 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T09:20:00.681 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T09:20:00.681 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T09:20:00.681 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T09:20:00.681 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T09:20:00.681 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T09:20:00.682 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T09:20:00.682 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T09:20:00.682 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T09:20:00.682 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T09:20:00.682 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T09:20:00.683 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T09:20:00.683 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T09:20:00.683 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T09:20:00.683 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T09:20:00.683 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T09:20:00.684 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T09:20:00.684 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T09:20:00.684 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T09:20:00.684 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T09:20:00.684 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T09:20:00.685 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T09:20:00.685 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T09:20:00.685 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T09:20:00.685 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T09:20:00.685 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T09:20:00.686 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T09:20:00.686 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T09:20:00.686 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T09:20:00.686 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T09:20:00.686 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T09:20:00.687 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T09:20:00.687 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T09:20:00.687 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T09:20:00.687 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T09:20:00.687 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T09:20:00.688 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T09:20:00.688 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T09:20:00.688 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T09:20:00.688 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T09:20:00.688 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T09:20:00.689 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T09:20:00.689 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.ttl: 2592000 2021-01-27T09:20:00.689 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T09:20:00.689 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T09:20:00.689 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T09:20:00.690 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739200467450, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T09:20:00.690 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T09:20:00.690 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T09:20:00.690 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739200468163, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611739200, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T09:20:00.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T09:20:00.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.463+0000 7f40edaed700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739200468928, "job": 1, "event": "recovery_finished"} 2021-01-27T09:20:00.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40edaed700 4 rocksdb: DB pointer 0x55f5dd983800 2021-01-27T09:20:00.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40d490e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T09:20:00.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40d490e700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T09:20:00.692 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** DB Stats ** 2021-01-27T09:20:00.692 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:00.692 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T09:20:00.692 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T09:20:00.693 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:20:00.693 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T09:20:00.693 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T09:20:00.693 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:20:00.693 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** Compaction Stats [default] ** 2021-01-27T09:20:00.694 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:00.694 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:00.694 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.694 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.695 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.695 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** Compaction Stats [default] ** 2021-01-27T09:20:00.695 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:00.695 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:00.695 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.696 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:00.696 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:00.696 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:00.696 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:20:00.696 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:20:00.697 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:20:00.697 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:00.697 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:00.697 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:20:00.697 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:20:00.698 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** Compaction Stats [default] ** 2021-01-27T09:20:00.698 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:00.698 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:00.698 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.698 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.699 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:20:00.699 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** Compaction Stats [default] ** 2021-01-27T09:20:00.699 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:00.699 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:00.699 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:00.700 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:00.700 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:00.700 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:00.700 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:20:00.701 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:20:00.701 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:20:00.701 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:00.701 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:00.702 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:20:00.702 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:20:00.702 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40edaed700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-01-27T09:20:00.702 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40edaed700 0 using public_addrv [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:20:00.702 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.467+0000 7f40edaed700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] at bind addrs [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:00.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.471+0000 7f40edaed700 1 mon.c@-1(???) e0 preinit fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:00.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 0 mon.c@-1(synchronizing).mds e1 new map 2021-01-27T09:20:00.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-01-27T09:20:00.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: e1 2021-01-27T09:20:00.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T09:20:00.704 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T09:20:00.704 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: legacy client fscid: -1 2021-01-27T09:20:00.704 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: 2021-01-27T09:20:00.704 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: No filesystems configured 2021-01-27T09:20:00.705 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T09:20:00.705 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T09:20:00.705 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T09:20:00.705 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T09:20:00.705 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T09:20:00.706 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.491+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T09:20:00.706 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T09:20:00.706 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T09:20:00.706 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T09:20:00.706 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:00.707 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:00.707 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:00.707 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: audit 2021-01-27T09:19:59.295204+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:00.707 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: audit 2021-01-27T09:19:59.300846+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:00.707 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: cluster 2021-01-27T09:20:00.128844+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:00.708 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-01-27T09:20:00.708 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expand map: {default=false} 2021-01-27T09:20:00.708 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T09:20:00.708 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T09:20:00.709 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expand map: {default=info} 2021-01-27T09:20:00.709 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T09:20:00.709 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T09:20:00.709 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T09:20:00.709 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T09:20:00.710 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T09:20:00.710 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T09:20:00.710 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T09:20:00.710 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T09:20:00.710 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:00 smithi103 bash[13570]: debug 2021-01-27T09:20:00.495+0000 7f40d7113700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-01-27T09:20:05.802 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 -- 172.21.15.103:0/865941719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb744003250 msgr2=0x7fb7440056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:05.803 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 --2- 172.21.15.103:0/865941719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb744003250 0x7fb7440056e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb75c0f83f0 tx=0x7fb75000b040).stop 2021-01-27T09:20:05.803 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 -- 172.21.15.103:0/865941719 shutdown_connections 2021-01-27T09:20:05.803 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 --2- 172.21.15.103:0/865941719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb744003250 0x7fb7440056e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:05.803 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 -- 172.21.15.103:0/865941719 >> 172.21.15.103:0/865941719 conn(0x7fb75c0601c0 msgr2=0x7fb75c0f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:05.804 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 -- 172.21.15.103:0/865941719 shutdown_connections 2021-01-27T09:20:05.804 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.799+0000 7fb7610be700 1 -- 172.21.15.103:0/865941719 wait complete. 2021-01-27T09:20:05.805 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 Processor -- start 2021-01-27T09:20:05.805 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 -- start start 2021-01-27T09:20:05.805 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:05.805 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 0x7fb75c107da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:05.805 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c107410 con 0x7fb75c106eb0 2021-01-27T09:20:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb7610be700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c107550 con 0x7fb744003250 2021-01-27T09:20:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 0x7fb75c107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:05.807 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:60338/0 (socket says 172.21.15.103:60338) 2021-01-27T09:20:05.808 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 -- 172.21.15.103:0/2310489005 learned_addr learned my addr 172.21.15.103:0/2310489005 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:20:05.808 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 -- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 msgr2=0x7fb75c1069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2021-01-27T09:20:05.808 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 -- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 msgr2=0x7fb75c1069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-27T09:20:05.808 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:20:05.808 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75bfff700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:20:05.809 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75b7fe700 1 -- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 msgr2=0x7fb75c1069c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:20:05.809 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75b7fe700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:05.809 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75b7fe700 1 -- 172.21.15.103:0/2310489005 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c108290 con 0x7fb75c106eb0 2021-01-27T09:20:05.809 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb75b7fe700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 0x7fb75c107da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb74c00bae0 tx=0x7fb74c009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:05.809 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb74c00c870 con 0x7fb75c106eb0 2021-01-27T09:20:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb74c00ce30 con 0x7fb75c106eb0 2021-01-27T09:20:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.803+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb74c015e80 con 0x7fb75c106eb0 2021-01-27T09:20:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c108540 con 0x7fb75c106eb0 2021-01-27T09:20:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c108ab0 con 0x7fb75c106eb0 2021-01-27T09:20:05.811 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fb74c01e3f0 con 0x7fb75c106eb0 2021-01-27T09:20:05.812 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c0581f0 con 0x7fb75c106eb0 2021-01-27T09:20:05.812 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb758ff9700 1 --2- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 0x7fb748032280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:05.812 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7fb74c03f8c0 con 0x7fb75c106eb0 2021-01-27T09:20:05.812 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.807+0000 7fb75bfff700 1 --2- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 0x7fb748032280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:05.813 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.811+0000 7fb75bfff700 1 --2- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 0x7fb748032280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb750009f70 tx=0x7fb75000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:05.818 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:05.815+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb74c01e680 con 0x7fb75c106eb0 2021-01-27T09:20:05.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:00.508644+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:05.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: audit 2021-01-27T09:20:01.503628+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:02.129369+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:05.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: audit 2021-01-27T09:20:02.503683+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:02.507331+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:05.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: audit 2021-01-27T09:20:03.504030+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:04.129871+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:05.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: audit 2021-01-27T09:20:04.503946+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: audit 2021-01-27T09:20:05.504078+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.531755+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T09:20:05.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.537422+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:05.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.537535+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T09:20:05.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.537595+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:05.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.538130+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 67s) 2021-01-27T09:20:05.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[13570]: cluster 2021-01-27T09:20:05.543549+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T09:20:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:00.508644+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:05.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: audit 2021-01-27T09:20:01.503628+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:02.129369+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:05.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: audit 2021-01-27T09:20:02.503683+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:02.507331+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:05.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: audit 2021-01-27T09:20:03.504030+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:04.129871+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:05.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: audit 2021-01-27T09:20:04.503946+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: audit 2021-01-27T09:20:05.504078+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:05.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.531755+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T09:20:05.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.537422+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:05.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.537535+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T09:20:05.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.537595+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:05.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.538130+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 67s) 2021-01-27T09:20:05.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:05 smithi103 bash[9772]: cluster 2021-01-27T09:20:05.543549+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T09:20:06.050 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.047+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb75c044bc0 con 0x7fb75c106eb0 2021-01-27T09:20:06.051 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.051+0000 7fb758ff9700 1 -- 172.21.15.103:0/2310489005 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+955 (secure 0 0 0) 0x7fb74c012cb0 con 0x7fb75c106eb0 2021-01-27T09:20:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:20:06.052 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"fsid":"78337516-6080-11eb-8f9a-001a4aab830c","modified":"2021-01-27T09:20:00.505604Z","created":"2021-01-27T09:17:57.117248Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3301","nonce":0},{"type":"v1","addr":"172.21.15.103:6790","nonce":0}]},"addr":"172.21.15.103:6790/0","public_addr":"172.21.15.103:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-27T09:20:06.056 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 msgr2=0x7fb748032280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:06.056 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 --2- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 0x7fb748032280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb750009f70 tx=0x7fb75000b040).stop 2021-01-27T09:20:06.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 msgr2=0x7fb75c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:06.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 0x7fb75c107da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb74c00bae0 tx=0x7fb74c009220).stop 2021-01-27T09:20:06.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 shutdown_connections 2021-01-27T09:20:06.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 --2- 172.21.15.103:0/2310489005 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb74802fdc0 0x7fb748032280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb744003250 0x7fb75c1069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 --2- 172.21.15.103:0/2310489005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c106eb0 0x7fb75c107da0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 >> 172.21.15.103:0/2310489005 conn(0x7fb75c0601c0 msgr2=0x7fb75c0fb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 shutdown_connections 2021-01-27T09:20:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:06.055+0000 7fb7610be700 1 -- 172.21.15.103:0/2310489005 wait complete. 2021-01-27T09:20:06.059 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 2 2021-01-27T09:20:06.729 INFO:tasks.cephadm:Adding mon.b on smithi047 2021-01-27T09:20:06.729 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon smithi047:172.21.15.47=b 2021-01-27T09:20:06.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[9772]: audit 2021-01-27T09:20:06.054057+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.103:0/2310489005' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T09:20:06.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[9772]: cluster 2021-01-27T09:20:06.130421+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:06.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[9772]: audit 2021-01-27T09:20:06.504314+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:06.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[13570]: audit 2021-01-27T09:20:06.054057+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.103:0/2310489005' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T09:20:06.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[13570]: cluster 2021-01-27T09:20:06.130421+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:06.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:06 smithi103 bash[13570]: audit 2021-01-27T09:20:06.504314+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T09:20:08.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:08 smithi103 bash[9772]: cluster 2021-01-27T09:20:08.130873+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:08.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:08 smithi103 bash[13570]: cluster 2021-01-27T09:20:08.130873+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:09.812 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/673414598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c05f370 msgr2=0x7fcf1c0fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:09.812 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 --2- 172.21.15.47:0/673414598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c05f370 0x7fcf1c0fa5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcf0c004d00 tx=0x7fcf0c009b30).stop 2021-01-27T09:20:09.812 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/673414598 shutdown_connections 2021-01-27T09:20:09.812 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 --2- 172.21.15.47:0/673414598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c05f370 0x7fcf1c0fa5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:09.813 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/673414598 >> 172.21.15.47:0/673414598 conn(0x7fcf1c0efc60 msgr2=0x7fcf1c0f2080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:09.813 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/673414598 shutdown_connections 2021-01-27T09:20:09.813 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/673414598 wait complete. 2021-01-27T09:20:09.815 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 Processor -- start 2021-01-27T09:20:09.815 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- start start 2021-01-27T09:20:09.815 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:09.816 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:09.816 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1077b0 con 0x7fcf1c107250 2021-01-27T09:20:09.816 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c108550 con 0x7fcf1c05f370 2021-01-27T09:20:09.816 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:09.816 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:09.817 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.47:34218/0 (socket says 172.21.15.47:34218) 2021-01-27T09:20:09.817 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.47:41836/0 (socket says 172.21.15.47:41836) 2021-01-27T09:20:09.817 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 -- 172.21.15.47:0/3825566322 learned_addr learned my addr 172.21.15.47:0/3825566322 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:20:09.817 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 -- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 msgr2=0x7fcf1c106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2021-01-27T09:20:09.818 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 -- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 msgr2=0x7fcf1c106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-27T09:20:09.818 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:20:09.818 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf1affd700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:20:09.819 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 -- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 msgr2=0x7fcf1c106d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:20:09.819 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:09.819 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 -- 172.21.15.47:0/3825566322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c108710 con 0x7fcf1c107250 2021-01-27T09:20:09.819 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf13fff700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcf040096c0 tx=0x7fcf04006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:09.820 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fcf0400d6b0 con 0x7fcf1c107250 2021-01-27T09:20:09.820 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fcf0400dc70 con 0x7fcf1c107250 2021-01-27T09:20:09.820 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c1089c0 con 0x7fcf1c107250 2021-01-27T09:20:09.820 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.812+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fcf04011c90 con 0x7fcf1c107250 2021-01-27T09:20:09.820 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c10d2a0 con 0x7fcf1c107250 2021-01-27T09:20:09.821 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fcf04018030 con 0x7fcf1c107250 2021-01-27T09:20:09.822 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf137fe700 1 --2- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 0x7fcf08032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:09.822 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7fcf0403f480 con 0x7fcf1c107250 2021-01-27T09:20:09.822 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf1affd700 1 --2- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 0x7fcf08032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:09.822 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c0581f0 con 0x7fcf1c107250 2021-01-27T09:20:09.823 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.816+0000 7fcf1affd700 1 --2- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 0x7fcf08032270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcf0c00b740 tx=0x7fcf0c009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:09.829 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:09.828+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fcf04016020 con 0x7fcf1c107250 2021-01-27T09:20:10.019 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:10.020+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi047:172.21.15.47=b", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf1c0fcaa0 con 0x7fcf0802fdb0 2021-01-27T09:20:10.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[9772]: audit 2021-01-27T09:20:10.027166+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:10.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[9772]: audit 2021-01-27T09:20:10.029291+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:10.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[9772]: audit 2021-01-27T09:20:10.031740+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T09:20:10.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[13570]: audit 2021-01-27T09:20:10.027166+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:10.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[13570]: audit 2021-01-27T09:20:10.029291+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:10.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:10 smithi103 bash[13570]: audit 2021-01-27T09:20:10.031740+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T09:20:11.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[9772]: audit 2021-01-27T09:20:10.024066+0000 mgr.y (mgr.14138) 42 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi047:172.21.15.47=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:11.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[9772]: cephadm 2021-01-27T09:20:10.030791+0000 mgr.y (mgr.14138) 43 : cephadm [INF] Deploying daemon mon.b on smithi047 2021-01-27T09:20:11.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[9772]: cluster 2021-01-27T09:20:10.131409+0000 mgr.y (mgr.14138) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:11.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[13570]: audit 2021-01-27T09:20:10.024066+0000 mgr.y (mgr.14138) 42 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi047:172.21.15.47=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:11.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[13570]: cephadm 2021-01-27T09:20:10.030791+0000 mgr.y (mgr.14138) 43 : cephadm [INF] Deploying daemon mon.b on smithi047 2021-01-27T09:20:11.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:11 smithi103 bash[13570]: cluster 2021-01-27T09:20:10.131409+0000 mgr.y (mgr.14138) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:12.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:12 smithi103 bash[9772]: cluster 2021-01-27T09:20:12.131983+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:12.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:12 smithi103 bash[13570]: cluster 2021-01-27T09:20:12.131983+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:14.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:14 smithi103 bash[9772]: cluster 2021-01-27T09:20:14.132485+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:14.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:14 smithi103 bash[13570]: cluster 2021-01-27T09:20:14.132485+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:15.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.276+0000 7fcf137fe700 1 -- 172.21.15.47:0/3825566322 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7fcf1c0fcaa0 con 0x7fcf0802fdb0 2021-01-27T09:20:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:Deployed mon.b on host 'smithi047' 2021-01-27T09:20:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 msgr2=0x7fcf08032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 --2- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 0x7fcf08032270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcf0c00b740 tx=0x7fcf0c009b30).stop 2021-01-27T09:20:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 msgr2=0x7fcf1c108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcf040096c0 tx=0x7fcf04006e20).stop 2021-01-27T09:20:15.286 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 shutdown_connections 2021-01-27T09:20:15.286 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 --2- 172.21.15.47:0/3825566322 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcf0802fdb0 0x7fcf08032270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:15.286 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf1c05f370 0x7fcf1c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:15.286 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 --2- 172.21.15.47:0/3825566322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf1c107250 0x7fcf1c108060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:15.286 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 >> 172.21.15.47:0/3825566322 conn(0x7fcf1c0efc60 msgr2=0x7fcf1c0f0510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:15.287 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 shutdown_connections 2021-01-27T09:20:15.287 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:15.284+0000 7fcf21448700 1 -- 172.21.15.47:0/3825566322 wait complete. 2021-01-27T09:20:15.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:15 smithi103 bash[9772]: audit 2021-01-27T09:20:15.270796+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:15.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:15 smithi103 bash[9772]: audit 2021-01-27T09:20:15.275420+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:15.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:15 smithi103 bash[13570]: audit 2021-01-27T09:20:15.270796+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:15.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:15 smithi103 bash[13570]: audit 2021-01-27T09:20:15.275420+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:16.833 DEBUG:teuthology.orchestra.run.smithi047:mon.b> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@mon.b.service 2021-01-27T09:20:16.836 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-01-27T09:20:16.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T09:20:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:20:17.083 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.076+0000 7f13d6fef700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T09:20:17.084 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.076+0000 7f13d6fef700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T09:20:17.084 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.076+0000 7f13d6fef700 0 pidfile_write: ignore empty --pid-file 2021-01-27T09:20:17.085 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 0 load: jerasure load: lrc load: isa 2021-01-27T09:20:17.085 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T09:20:17.086 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T09:20:17.086 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T09:20:17.087 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: DB SUMMARY 2021-01-27T09:20:17.087 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T09:20:17.087 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T09:20:17.087 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T09:20:17.087 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-01-27T09:20:17.088 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 636 ; 2021-01-27T09:20:17.088 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T09:20:17.088 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T09:20:17.088 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T09:20:17.089 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.env: 0x55e701a4e1c0 2021-01-27T09:20:17.089 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.fs: Posix File System 2021-01-27T09:20:17.089 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.info_log: 0x55e704077e80 2021-01-27T09:20:17.299 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T09:20:17.299 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.statistics: (nil) 2021-01-27T09:20:17.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.use_fsync: 0 2021-01-27T09:20:17.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T09:20:17.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T09:20:17.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T09:20:17.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T09:20:17.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T09:20:17.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T09:20:17.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T09:20:17.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T09:20:17.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T09:20:17.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T09:20:17.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T09:20:17.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.db_log_dir: 2021-01-27T09:20:17.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-01-27T09:20:17.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T09:20:17.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T09:20:17.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T09:20:17.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T09:20:17.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T09:20:17.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T09:20:17.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T09:20:17.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T09:20:17.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T09:20:17.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T09:20:17.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.write_buffer_manager: 0x55e7040d1bf0 2021-01-27T09:20:17.309 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T09:20:17.309 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T09:20:17.310 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T09:20:17.310 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T09:20:17.310 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T09:20:17.311 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T09:20:17.311 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T09:20:17.312 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T09:20:17.312 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T09:20:17.312 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.unordered_write: 0 2021-01-27T09:20:17.313 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T09:20:17.313 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T09:20:17.314 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T09:20:17.314 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T09:20:17.315 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.row_cache: None 2021-01-27T09:20:17.315 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.wal_filter: None 2021-01-27T09:20:17.315 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T09:20:17.316 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T09:20:17.316 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T09:20:17.317 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T09:20:17.317 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T09:20:17.317 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T09:20:17.318 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T09:20:17.318 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T09:20:17.318 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T09:20:17.319 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T09:20:17.319 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T09:20:17.320 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T09:20:17.321 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T09:20:17.321 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T09:20:17.322 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T09:20:17.322 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T09:20:17.322 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T09:20:17.322 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T09:20:17.323 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T09:20:17.323 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T09:20:17.324 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T09:20:17.324 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_open_files: -1 2021-01-27T09:20:17.324 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T09:20:17.325 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T09:20:17.325 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T09:20:17.326 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T09:20:17.326 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Compression algorithms supported: 2021-01-27T09:20:17.326 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T09:20:17.326 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kZSTD supported: 0 2021-01-27T09:20:17.327 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T09:20:17.327 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T09:20:17.328 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T09:20:17.328 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T09:20:17.329 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T09:20:17.329 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T09:20:17.329 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T09:20:17.330 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-01-27T09:20:17.330 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T09:20:17.331 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T09:20:17.331 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.merge_operator: 2021-01-27T09:20:17.331 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_filter: None 2021-01-27T09:20:17.332 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T09:20:17.332 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T09:20:17.333 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T09:20:17.333 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e7040201e0) 2021-01-27T09:20:17.333 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: cache_index_and_filter_blocks: 1 2021-01-27T09:20:17.334 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T09:20:17.334 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T09:20:17.335 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: pin_top_level_index_and_filter: 1 2021-01-27T09:20:17.335 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: index_type: 0 2021-01-27T09:20:17.335 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: data_block_index_type: 0 2021-01-27T09:20:17.336 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: index_shortening: 1 2021-01-27T09:20:17.336 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T09:20:17.337 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: hash_index_allow_collision: 1 2021-01-27T09:20:17.337 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: checksum: 1 2021-01-27T09:20:17.338 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: no_block_cache: 0 2021-01-27T09:20:17.339 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_cache: 0x55e704058510 2021-01-27T09:20:17.339 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_cache_name: BinnedLRUCache 2021-01-27T09:20:17.340 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_cache_options: 2021-01-27T09:20:17.340 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: capacity : 536870912 2021-01-27T09:20:17.340 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: num_shard_bits : 4 2021-01-27T09:20:17.341 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: strict_capacity_limit : 0 2021-01-27T09:20:17.341 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: high_pri_pool_ratio: 0.000 2021-01-27T09:20:17.341 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_cache_compressed: (nil) 2021-01-27T09:20:17.342 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: persistent_cache: (nil) 2021-01-27T09:20:17.342 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_size: 4096 2021-01-27T09:20:17.342 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_size_deviation: 10 2021-01-27T09:20:17.343 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_restart_interval: 16 2021-01-27T09:20:17.343 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: index_block_restart_interval: 1 2021-01-27T09:20:17.343 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: metadata_block_size: 4096 2021-01-27T09:20:17.344 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: partition_filters: 0 2021-01-27T09:20:17.344 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: use_delta_encoding: 1 2021-01-27T09:20:17.344 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T09:20:17.345 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: whole_key_filtering: 1 2021-01-27T09:20:17.345 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: verify_compression: 0 2021-01-27T09:20:17.345 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: read_amp_bytes_per_bit: 0 2021-01-27T09:20:17.346 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: format_version: 2 2021-01-27T09:20:17.346 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: enable_index_compression: 1 2021-01-27T09:20:17.346 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: block_align: 0 2021-01-27T09:20:17.347 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T09:20:17.347 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T09:20:17.347 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression: NoCompression 2021-01-27T09:20:17.348 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T09:20:17.348 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T09:20:17.348 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T09:20:17.349 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.num_levels: 7 2021-01-27T09:20:17.349 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T09:20:17.349 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T09:20:17.349 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T09:20:17.350 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T09:20:17.350 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T09:20:17.351 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T09:20:17.351 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T09:20:17.351 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:20:17.352 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T09:20:17.352 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T09:20:17.352 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T09:20:17.353 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T09:20:17.353 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T09:20:17.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T09:20:17.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T09:20:17.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T09:20:17.355 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T09:20:17.355 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T09:20:17.355 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T09:20:17.356 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T09:20:17.356 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T09:20:17.356 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T09:20:17.357 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T09:20:17.357 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T09:20:17.357 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T09:20:17.357 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T09:20:17.358 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T09:20:17.358 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T09:20:17.358 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T09:20:17.359 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T09:20:17.359 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T09:20:17.360 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T09:20:17.360 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T09:20:17.360 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T09:20:17.361 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T09:20:17.361 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T09:20:17.362 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T09:20:17.362 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T09:20:17.362 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T09:20:17.363 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T09:20:17.363 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T09:20:17.364 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T09:20:17.364 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T09:20:17.364 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T09:20:17.365 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T09:20:17.365 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T09:20:17.365 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T09:20:17.365 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T09:20:17.366 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T09:20:17.366 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T09:20:17.367 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T09:20:17.367 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T09:20:17.367 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T09:20:17.367 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T09:20:17.367 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T09:20:17.368 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T09:20:17.368 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T09:20:17.368 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T09:20:17.368 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T09:20:17.368 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.ttl: 2592000 2021-01-27T09:20:17.369 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.080+0000 7f13d6fef700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T09:20:17.369 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T09:20:17.369 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T09:20:17.369 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739217091869, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T09:20:17.369 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T09:20:17.370 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T09:20:17.370 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739217092936, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611739217, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T09:20:17.370 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T09:20:17.371 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.088+0000 7f13d6fef700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611739217093656, "job": 1, "event": "recovery_finished"} 2021-01-27T09:20:17.371 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13d6fef700 4 rocksdb: DB pointer 0x55e704117800 2021-01-27T09:20:17.371 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13bde10700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T09:20:17.372 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13bde10700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T09:20:17.372 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** DB Stats ** 2021-01-27T09:20:17.372 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:17.373 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T09:20:17.373 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T09:20:17.373 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:20:17.374 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T09:20:17.374 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T09:20:17.374 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T09:20:17.375 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** Compaction Stats [default] ** 2021-01-27T09:20:17.375 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:17.376 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:17.376 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.376 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.377 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.377 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** Compaction Stats [default] ** 2021-01-27T09:20:17.377 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:17.378 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:17.378 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.379 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:17.379 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:17.379 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:17.380 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:20:17.380 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:20:17.381 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:20:17.381 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Cumulative compaction: 0.00 GB write, 0.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:17.381 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Interval compaction: 0.00 GB write, 0.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:17.382 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:20:17.382 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:20:17.382 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** Compaction Stats [default] ** 2021-01-27T09:20:17.383 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:17.383 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:17.384 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.384 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.384 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T09:20:17.385 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** Compaction Stats [default] ** 2021-01-27T09:20:17.385 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T09:20:17.386 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T09:20:17.386 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2021-01-27T09:20:17.386 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T09:20:17.387 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:17.387 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T09:20:17.388 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T09:20:17.388 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T09:20:17.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T09:20:17.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Cumulative compaction: 0.00 GB write, 0.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:17.390 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T09:20:17.390 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T09:20:17.391 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T09:20:17.391 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13d6fef700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-01-27T09:20:17.391 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13d6fef700 0 using public_addr v2:172.21.15.47:0/0 -> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:20:17.392 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13d6fef700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:17.392 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.092+0000 7f13d6fef700 1 mon.b@-1(???) e0 preinit fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:17.392 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).mds e1 new map 2021-01-27T09:20:17.392 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-01-27T09:20:17.393 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: e1 2021-01-27T09:20:17.393 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T09:20:17.393 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T09:20:17.393 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: legacy client fscid: -1 2021-01-27T09:20:17.393 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: 2021-01-27T09:20:17.394 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: No filesystems configured 2021-01-27T09:20:17.394 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T09:20:17.394 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T09:20:17.394 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T09:20:17.395 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T09:20:17.395 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T09:20:17.395 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T09:20:17.395 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T09:20:17.395 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T09:20:17.396 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T09:20:17.396 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:17.396 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:17.396 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.120+0000 7f13c0615700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T09:20:17.396 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: audit 2021-01-27T09:20:15.270796+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:17.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: audit 2021-01-27T09:20:15.275420+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:17.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-01-27T09:20:17.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expand map: {default=false} 2021-01-27T09:20:17.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T09:20:17.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T09:20:17.398 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expand map: {default=info} 2021-01-27T09:20:17.398 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T09:20:17.398 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T09:20:17.398 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T09:20:17.398 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T09:20:17.399 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T09:20:17.399 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T09:20:17.399 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T09:20:17.399 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T09:20:17.399 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:17 smithi047 bash[9721]: debug 2021-01-27T09:20:17.124+0000 7f13c0615700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-01-27T09:20:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: cephadm 2021-01-27T09:20:15.269537+0000 mgr.y (mgr.14138) 47 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:20:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: audit 2021-01-27T09:20:16.121608+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: audit 2021-01-27T09:20:16.128272+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: cephadm 2021-01-27T09:20:16.129144+0000 mgr.y (mgr.14138) 48 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T09:20:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: audit 2021-01-27T09:20:16.129769+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: audit 2021-01-27T09:20:16.131211+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: cephadm 2021-01-27T09:20:16.132322+0000 mgr.y (mgr.14138) 49 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:20:17.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: cluster 2021-01-27T09:20:16.132890+0000 mgr.y (mgr.14138) 50 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:17.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[9772]: audit 2021-01-27T09:20:16.133725+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:20:17.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: cephadm 2021-01-27T09:20:15.269537+0000 mgr.y (mgr.14138) 47 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:20:17.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: audit 2021-01-27T09:20:16.121608+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:17.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: audit 2021-01-27T09:20:16.128272+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:17.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: cephadm 2021-01-27T09:20:16.129144+0000 mgr.y (mgr.14138) 48 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T09:20:17.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: audit 2021-01-27T09:20:16.129769+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:17.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: audit 2021-01-27T09:20:16.131211+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:17.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: cephadm 2021-01-27T09:20:16.132322+0000 mgr.y (mgr.14138) 49 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:20:17.404 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: cluster 2021-01-27T09:20:16.132890+0000 mgr.y (mgr.14138) 50 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:17.404 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:17 smithi103 bash[13570]: audit 2021-01-27T09:20:16.133725+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:20:22.542 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:17.137756+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:22.543 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:17.137859+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:22.543 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:18.133052+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.543 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:18.133373+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.544 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:19.133310+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.544 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:20.133200+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.544 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:20.133789+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.544 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:21.133504+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.545 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:22.133806+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.545 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.134249+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.545 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.139478+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T09:20:22.545 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.144903+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],b=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:22.546 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.145035+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-27T09:20:22.546 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.145121+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:22.546 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.145540+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 84s) 2021-01-27T09:20:22.546 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.145960+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-01-27T09:20:22.547 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.153243+0000 mon.a (mon.0) 180 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-01-27T09:20:22.547 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.153291+0000 mon.a (mon.0) 181 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-01-27T09:20:22.547 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cluster 2021-01-27T09:20:22.153369+0000 mon.a (mon.0) 182 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] is down (out of quorum) 2021-01-27T09:20:22.547 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:22.157405+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:22.547 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cephadm 2021-01-27T09:20:22.158387+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T09:20:22.548 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:22.158941+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T09:20:22.548 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:22.160148+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:22.548 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: cephadm 2021-01-27T09:20:22.161031+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring daemon mgr.y on smithi103 2021-01-27T09:20:22.548 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[13570]: audit 2021-01-27T09:20:22.161795+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T09:20:22.549 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:17.137756+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:22.549 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:17.137859+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:22.549 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:18.133052+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.549 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:18.133373+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:19.133310+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:20.133200+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:20.133789+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:21.133504+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:22.133806+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:22.551 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.134249+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:22.551 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.139478+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T09:20:22.551 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.144903+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],b=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:22.551 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.145035+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-27T09:20:22.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.145121+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:22.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.145540+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 84s) 2021-01-27T09:20:22.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.145960+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-01-27T09:20:22.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.153243+0000 mon.a (mon.0) 180 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-01-27T09:20:22.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.153291+0000 mon.a (mon.0) 181 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-01-27T09:20:22.553 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cluster 2021-01-27T09:20:22.153369+0000 mon.a (mon.0) 182 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] is down (out of quorum) 2021-01-27T09:20:22.553 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:22.157405+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:22.553 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cephadm 2021-01-27T09:20:22.158387+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T09:20:22.554 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:22.158941+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T09:20:22.554 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:22.160148+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:22.554 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: cephadm 2021-01-27T09:20:22.161031+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring daemon mgr.y on smithi103 2021-01-27T09:20:22.554 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:22 smithi103 bash[9772]: audit 2021-01-27T09:20:22.161795+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T09:20:23.266 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 -- 172.21.15.47:0/2481655401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e98003250 msgr2=0x7f4e980056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:23.267 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 --2- 172.21.15.47:0/2481655401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e98003250 0x7f4e980056c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4eb00f61e0 tx=0x7f4ea400b040).stop 2021-01-27T09:20:23.267 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 -- 172.21.15.47:0/2481655401 shutdown_connections 2021-01-27T09:20:23.267 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 --2- 172.21.15.47:0/2481655401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e98003250 0x7f4e980056c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.268 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 -- 172.21.15.47:0/2481655401 >> 172.21.15.47:0/2481655401 conn(0x7f4eb00f0bb0 msgr2=0x7f4eb00f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:23.268 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 -- 172.21.15.47:0/2481655401 shutdown_connections 2021-01-27T09:20:23.268 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.264+0000 7f4eaffff700 1 -- 172.21.15.47:0/2481655401 wait complete. 2021-01-27T09:20:23.271 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 Processor -- start 2021-01-27T09:20:23.271 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- start start 2021-01-27T09:20:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 0x7f4eb0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb0107600 con 0x7f4eb0106fc0 2021-01-27T09:20:23.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb010f100 con 0x7f4eb01083a0 2021-01-27T09:20:23.273 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb010f240 con 0x7f4e98003250 2021-01-27T09:20:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaeffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 0x7f4eb0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37486/0 (socket says 172.21.15.47:37486) 2021-01-27T09:20:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaeffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 0x7f4eb0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.47:34256/0 (socket says 172.21.15.47:34256) 2021-01-27T09:20:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.47:41876/0 (socket says 172.21.15.47:41876) 2021-01-27T09:20:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 -- 172.21.15.47:0/1362329211 learned_addr learned my addr 172.21.15.47:0/1362329211 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:20:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 -- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 msgr2=0x7f4eb0107eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-01-27T09:20:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 -- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 msgr2=0x7f4eb0107eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-27T09:20:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:20:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eae7fc700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:20:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 -- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 msgr2=0x7f4eb0106ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 0x7f4eb0106ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 -- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 msgr2=0x7f4eb0107eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:20:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 -- 172.21.15.47:0/1362329211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb010f400 con 0x7f4eb01083a0 2021-01-27T09:20:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaf7fe700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4ea80096e0 tx=0x7f4ea8006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:23.279 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800d4a0 con 0x7f4eb01083a0 2021-01-27T09:20:23.279 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4ea800da60 con 0x7f4eb01083a0 2021-01-27T09:20:23.279 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb010f6b0 con 0x7f4eb01083a0 2021-01-27T09:20:23.281 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8012990 con 0x7f4eb01083a0 2021-01-27T09:20:23.281 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.268+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb010fba0 con 0x7f4eb01083a0 2021-01-27T09:20:23.282 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f4ea800f030 con 0x7f4eb01083a0 2021-01-27T09:20:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4e977fe700 1 --2- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 0x7f4e9c0325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f4ea8040680 con 0x7f4eb01083a0 2021-01-27T09:20:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4eaeffd700 1 --2- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 0x7f4e9c0325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:23.283 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb00581f0 con 0x7f4eb01083a0 2021-01-27T09:20:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.272+0000 7f4eaeffd700 1 --2- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 0x7f4e9c0325c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4ea40097c0 tx=0x7f4ea400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.284+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f4ea801b3e0 con 0x7f4eb01083a0 2021-01-27T09:20:23.513 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.512+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4eb0110240 con 0x7f4eb01083a0 2021-01-27T09:20:23.514 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.512+0000 7f4e977fe700 1 -- 172.21.15.47:0/1362329211 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1219 (secure 0 0 0) 0x7f4ea8019300 con 0x7f4eb01083a0 2021-01-27T09:20:23.514 INFO:teuthology.orchestra.run.smithi047.stdout: 2021-01-27T09:20:23.514 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"fsid":"78337516-6080-11eb-8f9a-001a4aab830c","modified":"2021-01-27T09:20:17.133886Z","created":"2021-01-27T09:17:57.117248Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3301","nonce":0},{"type":"v1","addr":"172.21.15.103:6790","nonce":0}]},"addr":"172.21.15.103:6790/0","public_addr":"172.21.15.103:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-27T09:20:23.518 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 msgr2=0x7f4e9c0325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:23.518 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 0x7f4e9c0325c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4ea40097c0 tx=0x7f4ea400b040).stop 2021-01-27T09:20:23.518 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 msgr2=0x7f4eb0108820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:23.519 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4ea80096e0 tx=0x7f4ea8006d60).stop 2021-01-27T09:20:23.519 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 shutdown_connections 2021-01-27T09:20:23.519 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e9c030100 0x7f4e9c0325c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.519 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb01083a0 0x7f4eb0108820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.519 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e98003250 0x7f4eb0106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.520 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 --2- 172.21.15.47:0/1362329211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0106fc0 0x7f4eb0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:23.520 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 >> 172.21.15.47:0/1362329211 conn(0x7f4eb00f0bb0 msgr2=0x7f4eb0068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:23.520 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 shutdown_connections 2021-01-27T09:20:23.520 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:23.516+0000 7f4eaffff700 1 -- 172.21.15.47:0/1362329211 wait complete. 2021-01-27T09:20:23.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:23 smithi103 bash[9772]: audit 2021-01-27T09:20:23.133849+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:23.521 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:23 smithi103 bash[13570]: audit 2021-01-27T09:20:23.133849+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 3 2021-01-27T09:20:24.259 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-01-27T09:20:24.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph config generate-minimal-conf 2021-01-27T09:20:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: audit 2021-01-27T09:20:23.133849+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:19.137540+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.134701+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.139903+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:24.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.139930+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:24.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.140157+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.143580+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T09:20:24.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.152993+0000 mon.a (mon.0) 192 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],b=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:24.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.153070+0000 mon.a (mon.0) 193 : cluster [DBG] fsmap 2021-01-27T09:20:24.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.153117+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:24.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.153399+0000 mon.a (mon.0) 195 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-27T09:20:24.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.153637+0000 mon.a (mon.0) 196 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-27T09:20:24.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.153671+0000 mon.a (mon.0) 197 : cluster [INF] Cluster is now healthy 2021-01-27T09:20:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: cluster 2021-01-27T09:20:24.160061+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2021-01-27T09:20:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: audit 2021-01-27T09:20:24.214149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: audit 2021-01-27T09:20:24.215837+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: audit 2021-01-27T09:20:24.217238+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:24 smithi047 bash[9721]: audit 2021-01-27T09:20:24.219356+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T09:20:24.610 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:19.137540+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.134701+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:24.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.139903+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:24.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.139930+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:24.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.140157+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.143580+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T09:20:24.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.152993+0000 mon.a (mon.0) 192 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],b=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:24.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.153070+0000 mon.a (mon.0) 193 : cluster [DBG] fsmap 2021-01-27T09:20:24.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.153117+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:24.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.153399+0000 mon.a (mon.0) 195 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-27T09:20:24.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.153637+0000 mon.a (mon.0) 196 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-27T09:20:24.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.153671+0000 mon.a (mon.0) 197 : cluster [INF] Cluster is now healthy 2021-01-27T09:20:24.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: cluster 2021-01-27T09:20:24.160061+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2021-01-27T09:20:24.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: audit 2021-01-27T09:20:24.214149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:24.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: audit 2021-01-27T09:20:24.215837+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:24.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: audit 2021-01-27T09:20:24.217238+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:24.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[13570]: audit 2021-01-27T09:20:24.219356+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T09:20:24.614 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:19.137540+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.134701+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:24.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.139903+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2021-01-27T09:20:24.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.139930+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-01-27T09:20:24.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.140157+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-27T09:20:24.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.143580+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T09:20:24.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.152993+0000 mon.a (mon.0) 192 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],b=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0],c=[v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0]} 2021-01-27T09:20:24.618 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.153070+0000 mon.a (mon.0) 193 : cluster [DBG] fsmap 2021-01-27T09:20:24.618 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.153117+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T09:20:24.618 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.153399+0000 mon.a (mon.0) 195 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-27T09:20:24.618 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.153637+0000 mon.a (mon.0) 196 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-27T09:20:24.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.153671+0000 mon.a (mon.0) 197 : cluster [INF] Cluster is now healthy 2021-01-27T09:20:24.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: cluster 2021-01-27T09:20:24.160061+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2021-01-27T09:20:24.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: audit 2021-01-27T09:20:24.214149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:24.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: audit 2021-01-27T09:20:24.215837+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:24.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: audit 2021-01-27T09:20:24.217238+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:24.620 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:24 smithi103 bash[9772]: audit 2021-01-27T09:20:24.219356+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T09:20:25.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:25 smithi047 bash[9721]: cephadm 2021-01-27T09:20:24.215289+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T09:20:25.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:25 smithi047 bash[9721]: cephadm 2021-01-27T09:20:24.218469+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi103 2021-01-27T09:20:25.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:25 smithi047 bash[9721]: audit 2021-01-27T09:20:25.134332+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:25.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[13570]: cephadm 2021-01-27T09:20:24.215289+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T09:20:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[13570]: cephadm 2021-01-27T09:20:24.218469+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi103 2021-01-27T09:20:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[13570]: audit 2021-01-27T09:20:25.134332+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:25.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[9772]: cephadm 2021-01-27T09:20:24.215289+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T09:20:25.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[9772]: cephadm 2021-01-27T09:20:24.218469+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi103 2021-01-27T09:20:25.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:25 smithi103 bash[9772]: audit 2021-01-27T09:20:25.134332+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T09:20:26.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:26 smithi103 bash[13570]: cluster 2021-01-27T09:20:26.135358+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:26.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:26 smithi103 bash[9772]: cluster 2021-01-27T09:20:26.135358+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:26.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:26 smithi047 bash[9721]: cluster 2021-01-27T09:20:26.135358+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:27.987 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/3539286663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08140f5600 msgr2=0x7f08140f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 --2- 172.21.15.103:0/3539286663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08140f5600 0x7f08140f5a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0810004d00 tx=0x7f0810009b30).stop 2021-01-27T09:20:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/3539286663 shutdown_connections 2021-01-27T09:20:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 --2- 172.21.15.103:0/3539286663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08140f5600 0x7f08140f5a20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/3539286663 >> 172.21.15.103:0/3539286663 conn(0x7f08140f0d60 msgr2=0x7f08140f3180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/3539286663 shutdown_connections 2021-01-27T09:20:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/3539286663 wait complete. 2021-01-27T09:20:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 Processor -- start 2021-01-27T09:20:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- start start 2021-01-27T09:20:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08140f5600 0x7f081406aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:27.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:27.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 0x7f0814113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:27.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08141089b0 con 0x7f08140f5600 2021-01-27T09:20:27.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814113910 con 0x7f0814069880 2021-01-27T09:20:27.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814113a50 con 0x7f0814068f10 2021-01-27T09:20:27.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:27.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:60352/0 (socket says 172.21.15.103:60352) 2021-01-27T09:20:27.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 -- 172.21.15.103:0/2201257589 learned_addr learned my addr 172.21.15.103:0/2201257589 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:20:27.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0819b75700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 0x7f0814113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0819374700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08140f5600 0x7f081406aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 -- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 msgr2=0x7f0814113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 0x7f0814113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 -- 172.21.15.103:0/2201257589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08140f5600 msgr2=0x7f081406aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08140f5600 0x7f081406aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 -- 172.21.15.103:0/2201257589 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814113b90 con 0x7f0814068f10 2021-01-27T09:20:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0819b75700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 0x7f0814113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:20:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0818b73700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0804009890 tx=0x7f0804006ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400d5a0 con 0x7f0814068f10 2021-01-27T09:20:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f080400db60 con 0x7f0814068f10 2021-01-27T09:20:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.987+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0814113de0 con 0x7f0814068f10 2021-01-27T09:20:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400fa40 con 0x7f0814068f10 2021-01-27T09:20:27.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0814114250 con 0x7f0814068f10 2021-01-27T09:20:27.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f080400d700 con 0x7f0814068f10 2021-01-27T09:20:27.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0809ffb700 1 --2- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 0x7f08000325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:27.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08140581f0 con 0x7f0814068f10 2021-01-27T09:20:27.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f080403fa40 con 0x7f0814068f10 2021-01-27T09:20:27.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0819374700 1 --2- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 0x7f08000325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:27.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.991+0000 7f0819374700 1 --2- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 0x7f08000325c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0810004cd0 tx=0x7f0810009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:28.001 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:27.999+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f08040164f0 con 0x7f0814068f10 2021-01-27T09:20:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.167+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0814044bc0 con 0x7f0814068f10 2021-01-27T09:20:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.167+0000 7f0809ffb700 1 -- 172.21.15.103:0/2201257589 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f0804016310 con 0x7f0814068f10 2021-01-27T09:20:28.170 INFO:teuthology.orchestra.run.smithi103.stdout:# minimal ceph.conf for 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:28.170 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2021-01-27T09:20:28.170 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:20:28.171 INFO:teuthology.orchestra.run.smithi103.stdout: mon_host = [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:20:28.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 msgr2=0x7f08000325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:28.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 0x7f08000325c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0810004cd0 tx=0x7f0810009b30).stop 2021-01-27T09:20:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 msgr2=0x7f0814069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0804009890 tx=0x7f0804006ee0).stop 2021-01-27T09:20:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 shutdown_connections 2021-01-27T09:20:28.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0800030100 0x7f08000325c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814069880 0x7f0814113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08140f5600 0x7f081406aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 --2- 172.21.15.103:0/2201257589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0814068f10 0x7f0814069390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 >> 172.21.15.103:0/2201257589 conn(0x7f08140f0d60 msgr2=0x7f08140f15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 shutdown_connections 2021-01-27T09:20:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:28.171+0000 7f081b5d8700 1 -- 172.21.15.103:0/2201257589 wait complete. 2021-01-27T09:20:28.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: audit 2021-01-27T09:20:27.124443+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:28.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: cephadm 2021-01-27T09:20:27.125511+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T09:20:28.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: audit 2021-01-27T09:20:27.126072+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:28.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: audit 2021-01-27T09:20:27.127679+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:28.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: cephadm 2021-01-27T09:20:27.128885+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi047 2021-01-27T09:20:28.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[13570]: audit 2021-01-27T09:20:27.129823+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T09:20:28.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: audit 2021-01-27T09:20:27.124443+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:28.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: cephadm 2021-01-27T09:20:27.125511+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T09:20:28.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: audit 2021-01-27T09:20:27.126072+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: audit 2021-01-27T09:20:27.127679+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: cephadm 2021-01-27T09:20:27.128885+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi047 2021-01-27T09:20:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:28 smithi103 bash[9772]: audit 2021-01-27T09:20:27.129823+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T09:20:28.492 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: audit 2021-01-27T09:20:27.124443+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:28.493 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: cephadm 2021-01-27T09:20:27.125511+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T09:20:28.493 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: audit 2021-01-27T09:20:27.126072+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:28.493 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: audit 2021-01-27T09:20:27.127679+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:28.494 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: cephadm 2021-01-27T09:20:27.128885+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi047 2021-01-27T09:20:28.494 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:28 smithi047 bash[9721]: audit 2021-01-27T09:20:27.129823+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T09:20:28.833 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-01-27T09:20:28.834 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:20:28.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T09:20:28.846 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:20:28.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T09:20:28.905 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:20:28.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T09:20:28.997 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:20:28.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T09:20:29.049 INFO:tasks.cephadm:Adding mgr.y on smithi103 2021-01-27T09:20:29.050 INFO:tasks.cephadm:Adding mgr.x on smithi047 2021-01-27T09:20:29.051 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply mgr '3;smithi103=y;smithi047=x' 2021-01-27T09:20:29.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:29 smithi103 bash[9772]: cluster 2021-01-27T09:20:28.135698+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:29.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:29 smithi103 bash[9772]: audit 2021-01-27T09:20:28.172559+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.103:0/2201257589' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:29.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:29 smithi103 bash[13570]: cluster 2021-01-27T09:20:28.135698+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:29.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:29 smithi103 bash[13570]: audit 2021-01-27T09:20:28.172559+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.103:0/2201257589' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:29.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:29 smithi047 bash[9721]: cluster 2021-01-27T09:20:28.135698+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:29.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:29 smithi047 bash[9721]: audit 2021-01-27T09:20:28.172559+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.103:0/2201257589' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:31.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:29.885396+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:29.888051+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:29.888731+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: cluster 2021-01-27T09:20:30.136142+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:31.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.561479+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.692044+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.697869+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.699196+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:31.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.700541+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:31.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[9772]: audit 2021-01-27T09:20:30.702777+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:29.885396+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:29.888051+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:29.888731+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: cluster 2021-01-27T09:20:30.136142+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:31.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.561479+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.692044+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.697869+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.699196+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:31.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.700541+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:31.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:30 smithi103 bash[13570]: audit 2021-01-27T09:20:30.702777+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.248 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:29.885396+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.249 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:29.888051+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.249 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:29.888731+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:31.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: cluster 2021-01-27T09:20:30.136142+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:31.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.561479+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.692044+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.697869+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:31.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.699196+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T09:20:31.252 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.700541+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:31.252 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:30 smithi047 bash[9721]: audit 2021-01-27T09:20:30.702777+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T09:20:32.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:31 smithi103 bash[9772]: cephadm 2021-01-27T09:20:30.698664+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T09:20:32.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:31 smithi103 bash[9772]: cephadm 2021-01-27T09:20:30.701734+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:20:32.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:31 smithi103 bash[13570]: cephadm 2021-01-27T09:20:30.698664+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T09:20:32.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:31 smithi103 bash[13570]: cephadm 2021-01-27T09:20:30.701734+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:20:32.154 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:31 smithi047 bash[9721]: cephadm 2021-01-27T09:20:30.698664+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T09:20:32.154 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:31 smithi047 bash[9721]: cephadm 2021-01-27T09:20:30.701734+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi103 2021-01-27T09:20:32.376 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- 172.21.15.47:0/827563160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f4920 msgr2=0x7f9d6c0f4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:32.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/827563160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f4920 0x7f9d6c0f4d40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f9d68004e00 tx=0x7f9d68009b30).stop 2021-01-27T09:20:32.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- 172.21.15.47:0/827563160 shutdown_connections 2021-01-27T09:20:32.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/827563160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.378 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/827563160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f4920 0x7f9d6c0f4d40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.378 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/827563160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f5bc0 0x7f9d6c0f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.378 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- 172.21.15.47:0/827563160 >> 172.21.15.47:0/827563160 conn(0x7f9d6c0f0120 msgr2=0x7f9d6c0f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:32.379 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- 172.21.15.47:0/827563160 shutdown_connections 2021-01-27T09:20:32.379 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- 172.21.15.47:0/827563160 wait complete. 2021-01-27T09:20:32.381 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 Processor -- start 2021-01-27T09:20:32.381 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- start start 2021-01-27T09:20:32.381 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f4920 0x7f9d6c107b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:32.381 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f5bc0 0x7f9d6c108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:32.382 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:32.382 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c10f610 con 0x7f9d6c0f6510 2021-01-27T09:20:32.382 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c10f750 con 0x7f9d6c0f5bc0 2021-01-27T09:20:32.382 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d73ab6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c10f890 con 0x7f9d6c0f4920 2021-01-27T09:20:32.383 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d72053700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:32.383 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d71051700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f5bc0 0x7f9d6c108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:32.383 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d72053700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37508/0 (socket says 172.21.15.47:37508) 2021-01-27T09:20:32.383 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d72053700 1 -- 172.21.15.47:0/4163934881 learned_addr learned my addr 172.21.15.47:0/4163934881 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:20:32.384 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.376+0000 7f9d71852700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f4920 0x7f9d6c107b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:32.384 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 -- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f4920 msgr2=0x7f9d6c107b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:32.385 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f4920 0x7f9d6c107b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.385 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 -- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f5bc0 msgr2=0x7f9d6c108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:32.385 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f5bc0 0x7f9d6c108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.385 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 -- 172.21.15.47:0/4163934881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c10fa50 con 0x7f9d6c0f6510 2021-01-27T09:20:32.385 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d72053700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9d6400ee40 tx=0x7f9d6400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:32.386 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640097d0 con 0x7f9d6c0f6510 2021-01-27T09:20:32.386 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c10fd00 con 0x7f9d6c0f6510 2021-01-27T09:20:32.386 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c110220 con 0x7f9d6c0f6510 2021-01-27T09:20:32.386 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f9d6400f040 con 0x7f9d6c0f6510 2021-01-27T09:20:32.387 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64007620 con 0x7f9d6c0f6510 2021-01-27T09:20:32.388 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54004da0 con 0x7f9d6c0f6510 2021-01-27T09:20:32.388 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f9d64007a50 con 0x7f9d6c0f6510 2021-01-27T09:20:32.388 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 --2- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 0x7f9d580323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:32.388 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.380+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f9d6403f930 con 0x7f9d6c0f6510 2021-01-27T09:20:32.389 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.384+0000 7f9d71852700 1 --2- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 0x7f9d580323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:32.389 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.384+0000 7f9d71852700 1 --2- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 0x7f9d580323c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d68009c20 tx=0x7f9d68009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:32.389 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.388+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f9d6401b310 con 0x7f9d6c0f6510 2021-01-27T09:20:32.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.580+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=y;smithi047=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d54000bc0 con 0x7f9d5802ff00 2021-01-27T09:20:32.593 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.592+0000 7f9d627fc700 1 -- 172.21.15.47:0/4163934881 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9d54000bc0 con 0x7f9d5802ff00 2021-01-27T09:20:32.593 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled mgr update... 2021-01-27T09:20:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 msgr2=0x7f9d580323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 0x7f9d580323c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d68009c20 tx=0x7f9d68009b30).stop 2021-01-27T09:20:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 msgr2=0x7f9d6c10f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:32.596 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9d6400ee40 tx=0x7f9d6400b040).stop 2021-01-27T09:20:32.596 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 shutdown_connections 2021-01-27T09:20:32.596 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9d5802ff00 0x7f9d580323c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.596 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d6c0f6510 0x7f9d6c10f120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d6c0f4920 0x7f9d6c107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 --2- 172.21.15.47:0/4163934881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d6c0f5bc0 0x7f9d6c108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:32.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 >> 172.21.15.47:0/4163934881 conn(0x7f9d6c0f0120 msgr2=0x7f9d6c0f0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:32.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 shutdown_connections 2021-01-27T09:20:32.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:20:32.596+0000 7f9d73ab6700 1 -- 172.21.15.47:0/4163934881 wait complete. 2021-01-27T09:20:33.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:32 smithi047 bash[9721]: cluster 2021-01-27T09:20:32.136694+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:32 smithi047 bash[9721]: audit 2021-01-27T09:20:32.594832+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:32 smithi047 bash[9721]: audit 2021-01-27T09:20:32.746464+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:32 smithi047 bash[9721]: audit 2021-01-27T09:20:32.748790+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:33.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[9772]: cluster 2021-01-27T09:20:32.136694+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:33.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[9772]: audit 2021-01-27T09:20:32.594832+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[9772]: audit 2021-01-27T09:20:32.746464+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[9772]: audit 2021-01-27T09:20:32.748790+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:33.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[13570]: cluster 2021-01-27T09:20:32.136694+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:33.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[13570]: audit 2021-01-27T09:20:32.594832+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[13570]: audit 2021-01-27T09:20:32.746464+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:33.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:32 smithi103 bash[13570]: audit 2021-01-27T09:20:32.748790+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:33.439 DEBUG:teuthology.orchestra.run.smithi047:mgr.x> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@mgr.x.service 2021-01-27T09:20:33.443 INFO:tasks.cephadm:Deploying OSDs... 2021-01-27T09:20:33.444 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:20:33.445 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T09:20:33.453 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T09:20:33.453 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T09:20:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T09:20:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.463 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-01-27T09:20:33.464 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.464 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2021-01-27 09:14:50.191998852 +0000 2021-01-27T09:20:33.464 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2021-01-27 09:14:50.039998854 +0000 2021-01-27T09:20:33.464 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2021-01-27 09:14:50.039998854 +0000 2021-01-27T09:20:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2021-01-27T09:20:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2021-01-27T09:20:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2021-01-27T09:20:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000316083 s, 1.6 MB/s 2021-01-27T09:20:33.476 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T09:20:33.477 INFO:journalctl@ceph.mgr.x.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:20:33.526 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T09:20:33.526 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.526 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-01-27T09:20:33.527 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.527 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2021-01-27 09:14:50.555998848 +0000 2021-01-27T09:20:33.527 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2021-01-27 09:14:50.399998850 +0000 2021-01-27T09:20:33.527 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2021-01-27 09:14:50.399998850 +0000 2021-01-27T09:20:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2021-01-27T09:20:33.534 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2021-01-27T09:20:33.534 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2021-01-27T09:20:33.534 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00032148 s, 1.6 MB/s 2021-01-27T09:20:33.537 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T09:20:33.545 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T09:20:33.545 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.546 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-01-27T09:20:33.546 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.546 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2021-01-27 09:14:50.955998844 +0000 2021-01-27T09:20:33.546 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2021-01-27 09:14:50.787998846 +0000 2021-01-27T09:20:33.546 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2021-01-27 09:14:50.787998846 +0000 2021-01-27T09:20:33.547 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2021-01-27T09:20:33.551 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2021-01-27T09:20:33.552 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2021-01-27T09:20:33.552 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000325867 s, 1.6 MB/s 2021-01-27T09:20:33.555 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T09:20:33.562 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T09:20:33.562 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.563 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-01-27T09:20:33.563 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.563 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2021-01-27 09:14:51.335998840 +0000 2021-01-27T09:20:33.564 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2021-01-27 09:14:51.167998842 +0000 2021-01-27T09:20:33.564 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2021-01-27 09:14:51.167998842 +0000 2021-01-27T09:20:33.564 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2021-01-27T09:20:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2021-01-27T09:20:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2021-01-27T09:20:33.568 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000313995 s, 1.6 MB/s 2021-01-27T09:20:33.571 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:20:33.572 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T09:20:33.595 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T09:20:33.596 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T09:20:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T09:20:33.645 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.646 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-01-27T09:20:33.646 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.647 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2021-01-27 09:14:48.959198096 +0000 2021-01-27T09:20:33.647 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2021-01-27 09:14:48.799198099 +0000 2021-01-27T09:20:33.647 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2021-01-27 09:14:48.799198099 +0000 2021-01-27T09:20:33.647 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2021-01-27T09:20:33.656 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2021-01-27T09:20:33.656 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2021-01-27T09:20:33.656 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000301341 s, 1.7 MB/s 2021-01-27T09:20:33.660 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T09:20:33.666 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T09:20:33.667 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.667 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-01-27T09:20:33.667 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.668 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2021-01-27 09:14:49.339198087 +0000 2021-01-27T09:20:33.668 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2021-01-27 09:14:49.195198091 +0000 2021-01-27T09:20:33.668 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2021-01-27 09:14:49.195198091 +0000 2021-01-27T09:20:33.668 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2021-01-27T09:20:33.676 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2021-01-27T09:20:33.677 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2021-01-27T09:20:33.677 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000230697 s, 2.2 MB/s 2021-01-27T09:20:33.681 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T09:20:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T09:20:33.687 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.687 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-01-27T09:20:33.687 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.688 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2021-01-27 09:14:49.715198079 +0000 2021-01-27T09:20:33.688 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2021-01-27 09:14:49.547198083 +0000 2021-01-27T09:20:33.688 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2021-01-27 09:14:49.547198083 +0000 2021-01-27T09:20:33.688 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2021-01-27T09:20:33.695 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2021-01-27T09:20:33.695 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2021-01-27T09:20:33.695 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000286966 s, 1.8 MB/s 2021-01-27T09:20:33.700 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T09:20:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T09:20:33.750 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:20:33.751 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-01-27T09:20:33.751 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:20:33.752 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2021-01-27 09:14:50.107198070 +0000 2021-01-27T09:20:33.752 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2021-01-27 09:14:49.923198074 +0000 2021-01-27T09:20:33.752 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2021-01-27 09:14:49.923198074 +0000 2021-01-27T09:20:33.753 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2021-01-27T09:20:33.760 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2021-01-27T09:20:33.760 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2021-01-27T09:20:33.760 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000285774 s, 1.8 MB/s 2021-01-27T09:20:33.764 INFO:tasks.cephadm:Deploying osd.0 on smithi103 with /dev/vg_nvme/lv_4... 2021-01-27T09:20:33.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T09:20:34.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:32.586551+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=y;smithi047=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:34.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: cephadm 2021-01-27T09:20:32.588578+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi103=y;smithi047=x;count:3 2021-01-27T09:20:34.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.520028+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.524821+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.526488+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T09:20:34.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.531043+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T09:20:34.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.532476+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T09:20:34.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.534182+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:34.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:33 smithi047 bash[9721]: audit 2021-01-27T09:20:33.536262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T09:20:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:32.586551+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=y;smithi047=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: cephadm 2021-01-27T09:20:32.588578+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi103=y;smithi047=x;count:3 2021-01-27T09:20:34.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.520028+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.524821+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.526488+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T09:20:34.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.531043+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T09:20:34.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.532476+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T09:20:34.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.534182+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:34.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[9772]: audit 2021-01-27T09:20:33.536262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T09:20:34.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:32.586551+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=y;smithi047=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:34.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: cephadm 2021-01-27T09:20:32.588578+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi103=y;smithi047=x;count:3 2021-01-27T09:20:34.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.520028+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.524821+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:34.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.526488+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T09:20:34.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.531043+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T09:20:34.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.532476+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T09:20:34.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.534182+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:34.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:33 smithi103 bash[13570]: audit 2021-01-27T09:20:33.536262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T09:20:35.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[9772]: cephadm 2021-01-27T09:20:33.525713+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='x')] 2021-01-27T09:20:35.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[9772]: cephadm 2021-01-27T09:20:33.535169+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Deploying daemon mgr.x on smithi047 2021-01-27T09:20:35.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[9772]: cluster 2021-01-27T09:20:34.137225+0000 mgr.y (mgr.14138) 71 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:35.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[13570]: cephadm 2021-01-27T09:20:33.525713+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='x')] 2021-01-27T09:20:35.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[13570]: cephadm 2021-01-27T09:20:33.535169+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Deploying daemon mgr.x on smithi047 2021-01-27T09:20:35.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:34 smithi103 bash[13570]: cluster 2021-01-27T09:20:34.137225+0000 mgr.y (mgr.14138) 71 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:35.164 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:34 smithi047 bash[9721]: cephadm 2021-01-27T09:20:33.525713+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='x')] 2021-01-27T09:20:35.164 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:34 smithi047 bash[9721]: cephadm 2021-01-27T09:20:33.535169+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Deploying daemon mgr.x on smithi047 2021-01-27T09:20:35.164 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:34 smithi047 bash[9721]: cluster 2021-01-27T09:20:34.137225+0000 mgr.y (mgr.14138) 71 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:36.508 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:36 smithi103 bash[9772]: cluster 2021-01-27T09:20:36.137703+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:36.508 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:36 smithi103 bash[13570]: cluster 2021-01-27T09:20:36.137703+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:36.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:36 smithi047 bash[9721]: cluster 2021-01-27T09:20:36.137703+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:37.056 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T09:20:37.057 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T09:20:37.057 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2021-01-27T09:20:37.057 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2021-01-27T09:20:37.058 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145442 s, 721 MB/s 2021-01-27T09:20:37.058 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2021-01-27T09:20:37.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:36.259096+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:36.261707+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:36.262452+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:37.011503+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:37.063326+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:37.070336+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: cephadm 2021-01-27T09:20:37.071296+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:37.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[13570]: audit 2021-01-27T09:20:37.072764+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:36.259096+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:36.261707+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:36.262452+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:37.011503+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:37.063326+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:37.070336+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: cephadm 2021-01-27T09:20:37.071296+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:37.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:37 smithi103 bash[9772]: audit 2021-01-27T09:20:37.072764+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:36.259096+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:36.261707+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:36.262452+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:37.011503+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:37.063326+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:37.070336+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:37.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: cephadm 2021-01-27T09:20:37.071296+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:37.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[9721]: audit 2021-01-27T09:20:37.072764+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:37.549 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jan 27 09:20:37 smithi047 bash[10441]: debug 2021-01-27T09:20:37.456+0000 7fc9994d7700 1 -- 172.21.15.47:0/2055913417 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559bc54364e0 con 0x559bc5523000 2021-01-27T09:20:37.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2021-01-27T09:20:39.064 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[9772]: audit 2021-01-27T09:20:37.870860+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.064 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[9772]: audit 2021-01-27T09:20:37.877646+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.065 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[9772]: cephadm 2021-01-27T09:20:37.878426+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:39.065 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[9772]: cluster 2021-01-27T09:20:38.138257+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:39.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[13570]: audit 2021-01-27T09:20:37.870860+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[13570]: audit 2021-01-27T09:20:37.877646+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.066 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[13570]: cephadm 2021-01-27T09:20:37.878426+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:39.066 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:38 smithi103 bash[13570]: cluster 2021-01-27T09:20:38.138257+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:39.297 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:38 smithi047 bash[9721]: audit 2021-01-27T09:20:37.870860+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.298 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:38 smithi047 bash[9721]: audit 2021-01-27T09:20:37.877646+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:39.298 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:38 smithi047 bash[9721]: cephadm 2021-01-27T09:20:37.878426+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:20:39.298 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:38 smithi047 bash[9721]: cluster 2021-01-27T09:20:38.138257+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:40.531 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:40 smithi103 bash[9772]: cluster 2021-01-27T09:20:40.138765+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:40.531 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:40 smithi103 bash[13570]: cluster 2021-01-27T09:20:40.138765+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:40.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:40 smithi047 bash[9721]: cluster 2021-01-27T09:20:40.138765+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:40.660 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- 172.21.15.103:0/758049723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f005f710 msgr2=0x7f93f00f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:40.660 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- 172.21.15.103:0/758049723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f005f710 0x7f93f00f8540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f93d8004e00 tx=0x7f93d8009b30).stop 2021-01-27T09:20:40.660 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- 172.21.15.103:0/758049723 shutdown_connections 2021-01-27T09:20:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- 172.21.15.103:0/758049723 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f00fb4a0 0x7f93f00fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- 172.21.15.103:0/758049723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f005f710 0x7f93f00f8540 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- 172.21.15.103:0/758049723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00f8a30 0x7f93f00fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- 172.21.15.103:0/758049723 >> 172.21.15.103:0/758049723 conn(0x7f93f00effa0 msgr2=0x7f93f00f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- 172.21.15.103:0/758049723 shutdown_connections 2021-01-27T09:20:40.662 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- 172.21.15.103:0/758049723 wait complete. 2021-01-27T09:20:40.663 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 Processor -- start 2021-01-27T09:20:40.664 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- start start 2021-01-27T09:20:40.664 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f005f710 0x7f93f00f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:40.664 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:40.664 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00fb4a0 0x7f93f00f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00f5180 con 0x7f93f00fb4a0 2021-01-27T09:20:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00f52f0 con 0x7f93f00f8a30 2021-01-27T09:20:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93effff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f010f9b0 con 0x7f93f005f710 2021-01-27T09:20:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49376/0 (socket says 172.21.15.103:49376) 2021-01-27T09:20:40.666 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 -- 172.21.15.103:0/1928512126 learned_addr learned my addr 172.21.15.103:0/1928512126 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:20:40.666 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93eeffd700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f005f710 0x7f93f00f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:40.666 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93ef7fe700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00fb4a0 0x7f93f00f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:40.666 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 -- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f005f710 msgr2=0x7f93f00f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:40.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f005f710 0x7f93f00f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:40.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 -- 172.21.15.103:0/1928512126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00fb4a0 msgr2=0x7f93f00f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:40.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00fb4a0 0x7f93f00f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:40.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 -- 172.21.15.103:0/1928512126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f010fb70 con 0x7f93f00f8a30 2021-01-27T09:20:40.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.659+0000 7f93e7fff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f93e0002a20 tx=0x7f93e0009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:40.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0009320 con 0x7f93f00f8a30 2021-01-27T09:20:40.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f93e000f040 con 0x7f93f00f8a30 2021-01-27T09:20:40.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f010fe20 con 0x7f93f00f8a30 2021-01-27T09:20:40.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000d830 con 0x7f93f00f8a30 2021-01-27T09:20:40.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f0110350 con 0x7f93f00f8a30 2021-01-27T09:20:40.669 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f93e000dc60 con 0x7f93f00f8a30 2021-01-27T09:20:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 --2- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 0x7f93d0032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:20:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f93e003fc80 con 0x7f93f00f8a30 2021-01-27T09:20:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f005e310 con 0x7f93f00f8a30 2021-01-27T09:20:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93eeffd700 1 --2- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 0x7f93d0032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:20:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.663+0000 7f93eeffd700 1 --2- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 0x7f93d0032320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f93d8009c20 tx=0x7f93d8009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:20:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.667+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f93f005e310 con 0x7f93f00f8a30 2021-01-27T09:20:40.859 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:40.859+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f93f005e310 con 0x7f93d002fe60 2021-01-27T09:20:41.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: audit 2021-01-27T09:20:40.863941+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:41.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: audit 2021-01-27T09:20:40.865640+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:20:41.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: cephadm 2021-01-27T09:20:40.868696+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:20:41.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: audit 2021-01-27T09:20:40.869118+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:20:41.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: audit 2021-01-27T09:20:40.870539+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:41.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:41 smithi047 bash[9721]: audit 2021-01-27T09:20:40.872339+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:41.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: audit 2021-01-27T09:20:40.863941+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:41.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: audit 2021-01-27T09:20:40.865640+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:20:41.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: cephadm 2021-01-27T09:20:40.868696+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:20:41.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: audit 2021-01-27T09:20:40.869118+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:20:41.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: audit 2021-01-27T09:20:40.870539+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:41.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[13570]: audit 2021-01-27T09:20:40.872339+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:41.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: audit 2021-01-27T09:20:40.863941+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:20:41.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: audit 2021-01-27T09:20:40.865640+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:20:41.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: cephadm 2021-01-27T09:20:40.868696+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:20:41.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: audit 2021-01-27T09:20:40.869118+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:20:41.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: audit 2021-01-27T09:20:40.870539+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:41.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:41 smithi103 bash[9772]: audit 2021-01-27T09:20:40.872339+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:42.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:42 smithi103 bash[9772]: cluster 2021-01-27T09:20:42.139275+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:42.498 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:42 smithi103 bash[13570]: cluster 2021-01-27T09:20:42.139275+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:42.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:42 smithi047 bash[9721]: cluster 2021-01-27T09:20:42.139275+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:44.245 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:44.243+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f93e0014400 con 0x7f93f00f8a30 2021-01-27T09:20:44.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:44 smithi047 bash[9721]: cluster 2021-01-27T09:20:43.417600+0000 mon.a (mon.0) 240 : cluster [DBG] Standby manager daemon x started 2021-01-27T09:20:44.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:44 smithi047 bash[9721]: audit 2021-01-27T09:20:43.419325+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T09:20:44.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:44 smithi047 bash[9721]: audit 2021-01-27T09:20:43.421376+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T09:20:44.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:44 smithi047 bash[9721]: cluster 2021-01-27T09:20:44.139760+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:44.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[9772]: cluster 2021-01-27T09:20:43.417600+0000 mon.a (mon.0) 240 : cluster [DBG] Standby manager daemon x started 2021-01-27T09:20:44.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[9772]: audit 2021-01-27T09:20:43.419325+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T09:20:44.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[9772]: audit 2021-01-27T09:20:43.421376+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T09:20:44.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[9772]: cluster 2021-01-27T09:20:44.139760+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:44.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[13570]: cluster 2021-01-27T09:20:43.417600+0000 mon.a (mon.0) 240 : cluster [DBG] Standby manager daemon x started 2021-01-27T09:20:44.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[13570]: audit 2021-01-27T09:20:43.419325+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T09:20:44.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[13570]: audit 2021-01-27T09:20:43.421376+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.47:0/743385951' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T09:20:44.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:44 smithi103 bash[13570]: cluster 2021-01-27T09:20:44.139760+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:45.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: cluster 2021-01-27T09:20:44.249002+0000 mon.a (mon.0) 241 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-27T09:20:45.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: audit 2021-01-27T09:20:44.249144+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T09:20:45.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: audit 2021-01-27T09:20:44.708680+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.103:0/1297141245' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: audit 2021-01-27T09:20:44.709437+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: audit 2021-01-27T09:20:44.714868+0000 mon.a (mon.0) 244 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]': finished 2021-01-27T09:20:45.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: cluster 2021-01-27T09:20:44.714939+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T09:20:45.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:45 smithi047 bash[9721]: audit 2021-01-27T09:20:44.715176+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:20:45.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: cluster 2021-01-27T09:20:44.249002+0000 mon.a (mon.0) 241 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-27T09:20:45.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: audit 2021-01-27T09:20:44.249144+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T09:20:45.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: audit 2021-01-27T09:20:44.708680+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.103:0/1297141245' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: audit 2021-01-27T09:20:44.709437+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: audit 2021-01-27T09:20:44.714868+0000 mon.a (mon.0) 244 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]': finished 2021-01-27T09:20:45.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: cluster 2021-01-27T09:20:44.714939+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T09:20:45.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[9772]: audit 2021-01-27T09:20:44.715176+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:20:45.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: cluster 2021-01-27T09:20:44.249002+0000 mon.a (mon.0) 241 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-27T09:20:45.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: audit 2021-01-27T09:20:44.249144+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T09:20:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: audit 2021-01-27T09:20:44.708680+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.103:0/1297141245' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: audit 2021-01-27T09:20:44.709437+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]: dispatch 2021-01-27T09:20:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: audit 2021-01-27T09:20:44.714868+0000 mon.a (mon.0) 244 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f24ac20-7f89-43af-a3a8-639f9c8f6050"}]': finished 2021-01-27T09:20:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: cluster 2021-01-27T09:20:44.714939+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T09:20:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:45 smithi103 bash[13570]: audit 2021-01-27T09:20:44.715176+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:20:46.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:46 smithi047 bash[9721]: audit 2021-01-27T09:20:45.335465+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.15.103:0/527883074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:20:46.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:46 smithi047 bash[9721]: cluster 2021-01-27T09:20:46.140257+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:46.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:46 smithi103 bash[13570]: audit 2021-01-27T09:20:45.335465+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.15.103:0/527883074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:20:46.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:46 smithi103 bash[13570]: cluster 2021-01-27T09:20:46.140257+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:46.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:46 smithi103 bash[9772]: audit 2021-01-27T09:20:45.335465+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.15.103:0/527883074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:20:46.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:46 smithi103 bash[9772]: cluster 2021-01-27T09:20:46.140257+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:48.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:48 smithi047 bash[9721]: cluster 2021-01-27T09:20:48.140779+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:48.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:48 smithi103 bash[9772]: cluster 2021-01-27T09:20:48.140779+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:48.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:48 smithi103 bash[13570]: cluster 2021-01-27T09:20:48.140779+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:49.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:49 smithi047 bash[9721]: audit 2021-01-27T09:20:48.509311+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:49.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:49 smithi103 bash[9772]: audit 2021-01-27T09:20:48.509311+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:49.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:49 smithi103 bash[13570]: audit 2021-01-27T09:20:48.509311+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:50.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:50 smithi103 bash[9772]: cluster 2021-01-27T09:20:50.141263+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:50.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:50 smithi103 bash[13570]: cluster 2021-01-27T09:20:50.141263+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:50.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:50 smithi047 bash[9721]: cluster 2021-01-27T09:20:50.141263+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:52.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:52 smithi103 bash[13570]: cluster 2021-01-27T09:20:52.141823+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:52.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:52 smithi103 bash[13570]: cluster 2021-01-27T09:20:52.192977+0000 mon.a (mon.0) 249 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:20:52.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:52 smithi103 bash[9772]: cluster 2021-01-27T09:20:52.141823+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:52.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:52 smithi103 bash[9772]: cluster 2021-01-27T09:20:52.192977+0000 mon.a (mon.0) 249 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:20:52.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:52 smithi047 bash[9721]: cluster 2021-01-27T09:20:52.141823+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:52.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:52 smithi047 bash[9721]: cluster 2021-01-27T09:20:52.192977+0000 mon.a (mon.0) 249 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:20:53.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:53 smithi047 bash[9721]: audit 2021-01-27T09:20:52.464536+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T09:20:53.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:53 smithi047 bash[9721]: audit 2021-01-27T09:20:52.466071+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:53.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:53 smithi047 bash[9721]: cephadm 2021-01-27T09:20:52.467344+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Deploying daemon osd.0 on smithi103 2021-01-27T09:20:53.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:53 smithi047 bash[9721]: audit 2021-01-27T09:20:52.468010+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T09:20:53.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[13570]: audit 2021-01-27T09:20:52.464536+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T09:20:53.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[13570]: audit 2021-01-27T09:20:52.466071+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:53.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[13570]: cephadm 2021-01-27T09:20:52.467344+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Deploying daemon osd.0 on smithi103 2021-01-27T09:20:53.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[13570]: audit 2021-01-27T09:20:52.468010+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T09:20:53.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[9772]: audit 2021-01-27T09:20:52.464536+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T09:20:53.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[9772]: audit 2021-01-27T09:20:52.466071+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:20:53.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[9772]: cephadm 2021-01-27T09:20:52.467344+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Deploying daemon osd.0 on smithi103 2021-01-27T09:20:53.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:53 smithi103 bash[9772]: audit 2021-01-27T09:20:52.468010+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T09:20:54.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:54 smithi103 bash[9772]: cluster 2021-01-27T09:20:54.142367+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:54.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:54 smithi103 bash[13570]: cluster 2021-01-27T09:20:54.142367+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:54.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:54 smithi047 bash[9721]: cluster 2021-01-27T09:20:54.142367+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.023+0000 7f93e77fe700 1 -- 172.21.15.103:0/1928512126 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f93f005e310 con 0x7f93d002fe60 2021-01-27T09:20:55.026 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 0 on host 'smithi103' 2021-01-27T09:20:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 msgr2=0x7f93d0032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 0x7f93d0032320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f93d8009c20 tx=0x7f93d8009b30).stop 2021-01-27T09:20:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 msgr2=0x7f93f00f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:20:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f93e0002a20 tx=0x7f93e0009d40).stop 2021-01-27T09:20:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 shutdown_connections 2021-01-27T09:20:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> v2:172.21.15.103:6800/3303543367 conn(0x7f93d002fe60 0x7f93d0032320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93f00fb4a0 0x7f93f00f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f93f005f710 0x7f93f00f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 --2- 172.21.15.103:0/1928512126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f00f8a30 0x7f93f00f4440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:20:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 >> 172.21.15.103:0/1928512126 conn(0x7f93f00effa0 msgr2=0x7f93f00f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:20:55.029 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 shutdown_connections 2021-01-27T09:20:55.030 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:20:55.027+0000 7f93effff700 1 -- 172.21.15.103:0/1928512126 wait complete. 2021-01-27T09:20:55.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[9772]: cephadm 2021-01-27T09:20:55.021685+0000 mgr.y (mgr.14138) 87 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:20:55.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[9772]: audit 2021-01-27T09:20:55.021846+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:55.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[9772]: audit 2021-01-27T09:20:55.025597+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:55.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[13570]: cephadm 2021-01-27T09:20:55.021685+0000 mgr.y (mgr.14138) 87 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:20:55.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[13570]: audit 2021-01-27T09:20:55.021846+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:55.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:55 smithi103 bash[13570]: audit 2021-01-27T09:20:55.025597+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:55.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:55 smithi047 bash[9721]: cephadm 2021-01-27T09:20:55.021685+0000 mgr.y (mgr.14138) 87 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:20:55.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:55 smithi047 bash[9721]: audit 2021-01-27T09:20:55.021846+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:20:55.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:55 smithi047 bash[9721]: audit 2021-01-27T09:20:55.025597+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:56.378 DEBUG:teuthology.orchestra.run.smithi103:osd.0> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.0.service 2021-01-27T09:20:56.382 INFO:tasks.cephadm:Deploying osd.1 on smithi103 with /dev/vg_nvme/lv_3... 2021-01-27T09:20:56.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T09:20:56.432 INFO:journalctl@ceph.osd.0.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:20:56.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:56 smithi047 bash[9721]: cluster 2021-01-27T09:20:56.142905+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:56.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:56 smithi047 bash[9721]: audit 2021-01-27T09:20:56.210802+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:56.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:56 smithi047 bash[9721]: audit 2021-01-27T09:20:56.212155+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:56.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[13570]: cluster 2021-01-27T09:20:56.142905+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:56.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[13570]: audit 2021-01-27T09:20:56.210802+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:56.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[13570]: audit 2021-01-27T09:20:56.212155+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:56.597 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[9772]: cluster 2021-01-27T09:20:56.142905+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:56.598 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[9772]: audit 2021-01-27T09:20:56.210802+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:20:56.598 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:56 smithi103 bash[9772]: audit 2021-01-27T09:20:56.212155+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:20:57.891 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T09:20:57.891 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-01-27T09:20:57.892 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-01-27T09:20:57.892 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-01-27T09:20:57.892 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T09:20:57.892 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T09:20:57.892 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:20:57 smithi103 bash[16338]: --> ceph-volume lvm activate successful for osd ID: 0 2021-01-27T09:20:58.499 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:58 smithi103 bash[13570]: cluster 2021-01-27T09:20:58.143410+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:58.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:58 smithi103 bash[9772]: cluster 2021-01-27T09:20:58.143410+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:58.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:58 smithi047 bash[9721]: cluster 2021-01-27T09:20:58.143410+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:20:59.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:59 smithi103 bash[9772]: audit 2021-01-27T09:20:58.319830+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:20:59.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:20:59 smithi103 bash[9772]: audit 2021-01-27T09:20:58.321275+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:20:59.517 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:59 smithi103 bash[13570]: audit 2021-01-27T09:20:58.319830+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:20:59.518 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:20:59 smithi103 bash[13570]: audit 2021-01-27T09:20:58.321275+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:20:59.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:59 smithi047 bash[9721]: audit 2021-01-27T09:20:58.319830+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:20:59.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:20:59 smithi047 bash[9721]: audit 2021-01-27T09:20:58.321275+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:21:00.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:00 smithi103 bash[13570]: cluster 2021-01-27T09:21:00.143906+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:00.351 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:00 smithi103 bash[9772]: cluster 2021-01-27T09:21:00.143906+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:00 smithi047 bash[9721]: cluster 2021-01-27T09:21:00.143906+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:01.391 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 msgr2=0x5653f8d42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:21:01.392 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 msgr2=0x5653f8d42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:21:01.392 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_read_frame_preamble_main r=0 2021-01-27T09:21:01.392 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_MESSAGE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).throttle_message 2021-01-27T09:21:01.392 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_BYTES pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).throttle_bytes 2021-01-27T09:21:01.393 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).throttle_dispatch_queue 2021-01-27T09:21:01.393 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).read_frame_segment seg_idx=0 2021-01-27T09:21:01.393 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).read_frame_segment seg_idx=1 2021-01-27T09:21:01.393 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 msgr2=0x5653f8d42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:21:01.393 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_read_frame_segment r=0 2021-01-27T09:21:01.394 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 msgr2=0x5653f8d42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:21:01.394 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_read_frame_epilogue_main r=0 2021-01-27T09:21:01.394 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 10 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_read_frame_dispatch tag=17 2021-01-27T09:21:01.394 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_message 2021-01-27T09:21:01.394 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 5 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T09:21:01.395 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 5 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).handle_message received message m=0x5653f8d564e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:21:01.395 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 queue 0x5653f8d564e0 prio 196 2021-01-27T09:21:01.395 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 --2- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 0x5653f8d42300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x5653f8d51e60 tx=0x5653f8d860c0).read_frame 2021-01-27T09:21:01.395 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb3ae2700 1 -- 172.21.15.103:0/1583681394 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653f8d564e0 con 0x5653f8dd5400 2021-01-27T09:21:01.395 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb52e5700 20 -- 172.21.15.103:0/1583681394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5653f8dd5400 msgr2=0x5653f8d42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:21:01.396 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb3ae2700 10 -- 172.21.15.103:0/1583681394 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:21:01.396 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.127+0000 7fceb3ae2700 20 -- 172.21.15.103:0/1583681394 done calling dispatch on 0x5653f8d564e0 2021-01-27T09:21:02.126 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:01 smithi103 bash[16608]: debug 2021-01-27T09:21:01.679+0000 7fcebb56d200 -1 Falling back to public interface 2021-01-27T09:21:02.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:02 smithi103 bash[13570]: cluster 2021-01-27T09:21:02.144444+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:02.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:02 smithi103 bash[9772]: cluster 2021-01-27T09:21:02.144444+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:02.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:02 smithi047 bash[9721]: cluster 2021-01-27T09:21:02.144444+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T09:21:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T09:21:02.796 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2021-01-27T09:21:02.797 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2021-01-27T09:21:02.797 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.016554 s, 633 MB/s 2021-01-27T09:21:02.797 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2021-01-27T09:21:03.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2021-01-27T09:21:04.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:04 smithi047 bash[9721]: cluster 2021-01-27T09:21:04.145020+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:04.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:04 smithi103 bash[13570]: cluster 2021-01-27T09:21:04.145020+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:04.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:04 smithi103 bash[9772]: cluster 2021-01-27T09:21:04.145020+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:05.077 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:04 smithi103 bash[16608]: debug 2021-01-27T09:21:04.671+0000 7fcebb56d200 -1 osd.0 0 log_to_monitors {default=true} 2021-01-27T09:21:05.368 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:05 smithi103 bash[9772]: audit 2021-01-27T09:21:04.680046+0000 mon.a (mon.0) 259 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T09:21:05.369 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:05 smithi103 bash[9772]: audit 2021-01-27T09:21:04.925397+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:05.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:05 smithi103 bash[13570]: audit 2021-01-27T09:21:04.680046+0000 mon.a (mon.0) 259 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T09:21:05.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:05 smithi103 bash[13570]: audit 2021-01-27T09:21:04.925397+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:05.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:05 smithi047 bash[9721]: audit 2021-01-27T09:21:04.680046+0000 mon.a (mon.0) 259 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T09:21:05.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:05 smithi047 bash[9721]: audit 2021-01-27T09:21:04.925397+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:06.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.270058+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T09:21:06.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: cluster 2021-01-27T09:21:05.270211+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T09:21:06.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.270377+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:06.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.271311+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:06.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.316107+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.322919+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: cephadm 2021-01-27T09:21:05.323724+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: audit 2021-01-27T09:21:05.329794+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: cephadm 2021-01-27T09:21:05.330891+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:06 smithi047 bash[9721]: cluster 2021-01-27T09:21:06.145511+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:06.641 INFO:journalctl@ceph.osd.0.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[16608]: debug 2021-01-27T09:21:06.275+0000 7fceb1ade700 -1 osd.0 0 waiting for initial osdmap 2021-01-27T09:21:06.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.270058+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T09:21:06.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: cluster 2021-01-27T09:21:05.270211+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T09:21:06.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.270377+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:06.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.271311+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:06.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.316107+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.322919+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: cephadm 2021-01-27T09:21:05.323724+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: audit 2021-01-27T09:21:05.329794+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: cephadm 2021-01-27T09:21:05.330891+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[13570]: cluster 2021-01-27T09:21:06.145511+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:06.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.270058+0000 mon.a (mon.0) 261 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T09:21:06.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: cluster 2021-01-27T09:21:05.270211+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T09:21:06.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.270377+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:06.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.271311+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:06.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.316107+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.322919+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: cephadm 2021-01-27T09:21:05.323724+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: audit 2021-01-27T09:21:05.329794+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:06.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: cephadm 2021-01-27T09:21:05.330891+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:06.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:06 smithi103 bash[9772]: cluster 2021-01-27T09:21:06.145511+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:06.894 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- 172.21.15.103:0/1146865534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 msgr2=0x7f25fc0f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:06.895 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- 172.21.15.103:0/1146865534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc0f9740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f25f4009dc0 tx=0x7f25f4004d10).stop 2021-01-27T09:21:06.895 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- 172.21.15.103:0/1146865534 shutdown_connections 2021-01-27T09:21:06.896 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- 172.21.15.103:0/1146865534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc0f9740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:06.896 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- 172.21.15.103:0/1146865534 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc0f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:06.896 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- 172.21.15.103:0/1146865534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 0x7f25fc0f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:06.897 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- 172.21.15.103:0/1146865534 >> 172.21.15.103:0/1146865534 conn(0x7f25fc0effe0 msgr2=0x7f25fc0f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:21:06.897 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- 172.21.15.103:0/1146865534 shutdown_connections 2021-01-27T09:21:06.898 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- 172.21.15.103:0/1146865534 wait complete. 2021-01-27T09:21:06.910 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 Processor -- start 2021-01-27T09:21:06.910 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- start start 2021-01-27T09:21:06.910 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc10bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:06.911 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 0x7f25fc10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc10cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc10d540 con 0x7f25fc0f6810 2021-01-27T09:21:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc10d6b0 con 0x7f25fc0f92c0 2021-01-27T09:21:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fb59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc10d870 con 0x7f25fc05f7f0 2021-01-27T09:21:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fad9d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc10cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fa59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc10bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fad9d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc10cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49440/0 (socket says 172.21.15.103:49440) 2021-01-27T09:21:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25fad9d700 1 -- 172.21.15.103:0/2192130462 learned_addr learned my addr 172.21.15.103:0/2192130462 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:21:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.887+0000 7f25f9d9b700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 0x7f25fc10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 -- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 msgr2=0x7f25fc10cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc10cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 -- 172.21.15.103:0/2192130462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 msgr2=0x7f25fc10c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:06.917 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 0x7f25fc10c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:06.917 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 -- 172.21.15.103:0/2192130462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc10da30 con 0x7f25fc05f7f0 2021-01-27T09:21:06.917 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fa59c700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc10bcd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f25e400ea90 tx=0x7f25e400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:21:06.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400eed0 con 0x7f25fc05f7f0 2021-01-27T09:21:06.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc10dc80 con 0x7f25fc05f7f0 2021-01-27T09:21:06.919 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f25e400f040 con 0x7f25fc05f7f0 2021-01-27T09:21:06.919 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400c5f0 con 0x7f25fc05f7f0 2021-01-27T09:21:06.920 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc114450 con 0x7f25fc05f7f0 2021-01-27T09:21:06.920 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc0f3bb0 con 0x7f25fc05f7f0 2021-01-27T09:21:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f25e40092e0 con 0x7f25fc05f7f0 2021-01-27T09:21:06.921 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.891+0000 7f25f2ffd700 1 --2- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 0x7f25dc05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:06.922 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.895+0000 7f25f9d9b700 1 --2- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 0x7f25dc05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:06.922 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.895+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1744+0+0 (secure 0 0 0) 0x7f25e4074930 con 0x7f25fc05f7f0 2021-01-27T09:21:06.922 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.895+0000 7f25f9d9b700 1 --2- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 0x7f25dc05e0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f25ec004c40 tx=0x7f25ec00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:21:06.923 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:06.899+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f25e4048620 con 0x7f25fc05f7f0 2021-01-27T09:21:07.085 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:07.083+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f25fc027200 con 0x7f25dc05bc30 2021-01-27T09:21:07.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:06.271403+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:07.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: cluster 2021-01-27T09:21:06.271611+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T09:21:07.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:06.272565+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:06.282440+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:07.091062+0000 mgr.y (mgr.14138) 96 : audit [DBG] from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:07.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:07.092329+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:07.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: cephadm 2021-01-27T09:21:07.094457+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:07.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:07.094951+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:07.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:07.096445+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:07.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:07 smithi047 bash[9721]: audit 2021-01-27T09:21:07.098293+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:07.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:06.271403+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:07.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: cluster 2021-01-27T09:21:06.271611+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T09:21:07.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:06.272565+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:06.282440+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:07.091062+0000 mgr.y (mgr.14138) 96 : audit [DBG] from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:07.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:07.092329+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:07.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: cephadm 2021-01-27T09:21:07.094457+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:07.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:07.094951+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:07.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:07.096445+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:07.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[9772]: audit 2021-01-27T09:21:07.098293+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:07.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:06.271403+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 v2:172.21.15.103:6801/2602844757' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:07.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: cluster 2021-01-27T09:21:06.271611+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T09:21:07.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:06.272565+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:06.282440+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:07.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:07.091062+0000 mgr.y (mgr.14138) 96 : audit [DBG] from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:07.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:07.092329+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:07.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: cephadm 2021-01-27T09:21:07.094457+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:07.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:07.094951+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:07.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:07.096445+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:07.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:07 smithi103 bash[13570]: audit 2021-01-27T09:21:07.098293+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:08.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: cluster 2021-01-27T09:21:05.684012+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:08.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: cluster 2021-01-27T09:21:05.684204+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:08.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: cluster 2021-01-27T09:21:07.282065+0000 mon.a (mon.0) 276 : cluster [INF] osd.0 v2:172.21.15.103:6801/2602844757 boot 2021-01-27T09:21:08.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: cluster 2021-01-27T09:21:07.282164+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T09:21:08.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: audit 2021-01-27T09:21:07.282906+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:08.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:08 smithi047 bash[9721]: cluster 2021-01-27T09:21:08.146049+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:08.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: cluster 2021-01-27T09:21:05.684012+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:08.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: cluster 2021-01-27T09:21:05.684204+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:08.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: cluster 2021-01-27T09:21:07.282065+0000 mon.a (mon.0) 276 : cluster [INF] osd.0 v2:172.21.15.103:6801/2602844757 boot 2021-01-27T09:21:08.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: cluster 2021-01-27T09:21:07.282164+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T09:21:08.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: audit 2021-01-27T09:21:07.282906+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:08.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[9772]: cluster 2021-01-27T09:21:08.146049+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:08.580 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: cluster 2021-01-27T09:21:05.684012+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:08.580 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: cluster 2021-01-27T09:21:05.684204+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:08.580 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: cluster 2021-01-27T09:21:07.282065+0000 mon.a (mon.0) 276 : cluster [INF] osd.0 v2:172.21.15.103:6801/2602844757 boot 2021-01-27T09:21:08.580 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: cluster 2021-01-27T09:21:07.282164+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T09:21:08.581 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: audit 2021-01-27T09:21:07.282906+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T09:21:08.581 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:08 smithi103 bash[13570]: cluster 2021-01-27T09:21:08.146049+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T09:21:09.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:09 smithi047 bash[9721]: cluster 2021-01-27T09:21:08.284931+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T09:21:09.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:09 smithi047 bash[9721]: cluster 2021-01-27T09:21:09.286474+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T09:21:09.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:09 smithi103 bash[9772]: cluster 2021-01-27T09:21:08.284931+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T09:21:09.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:09 smithi103 bash[9772]: cluster 2021-01-27T09:21:09.286474+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T09:21:09.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:09 smithi103 bash[13570]: cluster 2021-01-27T09:21:08.284931+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T09:21:09.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:09 smithi103 bash[13570]: cluster 2021-01-27T09:21:09.286474+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T09:21:10.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:10 smithi047 bash[9721]: cluster 2021-01-27T09:21:10.146662+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v68: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:10.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:10 smithi103 bash[9772]: cluster 2021-01-27T09:21:10.146662+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v68: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:10.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:10 smithi103 bash[13570]: cluster 2021-01-27T09:21:10.146662+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v68: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:11.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[9772]: cluster 2021-01-27T09:21:10.290194+0000 mon.a (mon.0) 281 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T09:21:11.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[9772]: audit 2021-01-27T09:21:11.064421+0000 mon.a (mon.0) 282 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]: dispatch 2021-01-27T09:21:11.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[9772]: audit 2021-01-27T09:21:11.073642+0000 mon.a (mon.0) 283 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]': finished 2021-01-27T09:21:11.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[9772]: cluster 2021-01-27T09:21:11.073798+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T09:21:11.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[9772]: audit 2021-01-27T09:21:11.073954+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:11.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[13570]: cluster 2021-01-27T09:21:10.290194+0000 mon.a (mon.0) 281 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T09:21:11.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[13570]: audit 2021-01-27T09:21:11.064421+0000 mon.a (mon.0) 282 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]: dispatch 2021-01-27T09:21:11.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[13570]: audit 2021-01-27T09:21:11.073642+0000 mon.a (mon.0) 283 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]': finished 2021-01-27T09:21:11.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[13570]: cluster 2021-01-27T09:21:11.073798+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T09:21:11.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:11 smithi103 bash[13570]: audit 2021-01-27T09:21:11.073954+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:11.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:11 smithi047 bash[9721]: cluster 2021-01-27T09:21:10.290194+0000 mon.a (mon.0) 281 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T09:21:11.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:11 smithi047 bash[9721]: audit 2021-01-27T09:21:11.064421+0000 mon.a (mon.0) 282 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]: dispatch 2021-01-27T09:21:11.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:11 smithi047 bash[9721]: audit 2021-01-27T09:21:11.073642+0000 mon.a (mon.0) 283 : audit [INF] from='client.? 172.21.15.103:0/3814756002' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9402fe53-72fb-42a6-abd3-eb3566983eb5"}]': finished 2021-01-27T09:21:11.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:11 smithi047 bash[9721]: cluster 2021-01-27T09:21:11.073798+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T09:21:11.798 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:11 smithi047 bash[9721]: audit 2021-01-27T09:21:11.073954+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:12.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:12 smithi103 bash[9772]: audit 2021-01-27T09:21:11.673775+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.103:0/998077109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:12.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:12 smithi103 bash[9772]: cluster 2021-01-27T09:21:12.147400+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:12.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:12 smithi103 bash[13570]: audit 2021-01-27T09:21:11.673775+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.103:0/998077109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:12.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:12 smithi103 bash[13570]: cluster 2021-01-27T09:21:12.147400+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:12.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:12 smithi047 bash[9721]: audit 2021-01-27T09:21:11.673775+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.103:0/998077109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:12.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:12 smithi047 bash[9721]: cluster 2021-01-27T09:21:12.147400+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:14.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:14 smithi047 bash[9721]: cluster 2021-01-27T09:21:14.148104+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:14.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:14 smithi103 bash[9772]: cluster 2021-01-27T09:21:14.148104+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:14.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:14 smithi103 bash[13570]: cluster 2021-01-27T09:21:14.148104+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:15.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:15 smithi047 bash[9721]: audit 2021-01-27T09:21:14.944003+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:15.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:15 smithi103 bash[9772]: audit 2021-01-27T09:21:14.944003+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:15.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:15 smithi103 bash[13570]: audit 2021-01-27T09:21:14.944003+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:16.526 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:16 smithi103 bash[13570]: cluster 2021-01-27T09:21:16.148709+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:16.526 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:16 smithi103 bash[9772]: cluster 2021-01-27T09:21:16.148709+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:16.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:16 smithi047 bash[9721]: cluster 2021-01-27T09:21:16.148709+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:18.503 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:18 smithi103 bash[9772]: cluster 2021-01-27T09:21:18.149226+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:18.504 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:18 smithi103 bash[13570]: cluster 2021-01-27T09:21:18.149226+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:18.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:18 smithi047 bash[9721]: cluster 2021-01-27T09:21:18.149226+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:19.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:19 smithi047 bash[9721]: cluster 2021-01-27T09:21:18.241363+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:21:19.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:19 smithi047 bash[9721]: audit 2021-01-27T09:21:19.190327+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T09:21:19.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:19 smithi047 bash[9721]: audit 2021-01-27T09:21:19.191899+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:19.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:19 smithi047 bash[9721]: audit 2021-01-27T09:21:19.193732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T09:21:19.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[9772]: cluster 2021-01-27T09:21:18.241363+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:21:19.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[9772]: audit 2021-01-27T09:21:19.190327+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T09:21:19.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[9772]: audit 2021-01-27T09:21:19.191899+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:19.585 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[9772]: audit 2021-01-27T09:21:19.193732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T09:21:19.585 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[13570]: cluster 2021-01-27T09:21:18.241363+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T09:21:19.586 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[13570]: audit 2021-01-27T09:21:19.190327+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T09:21:19.586 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[13570]: audit 2021-01-27T09:21:19.191899+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:19.586 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:19 smithi103 bash[13570]: audit 2021-01-27T09:21:19.193732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T09:21:20.528 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:20 smithi103 bash[13570]: cephadm 2021-01-27T09:21:19.193160+0000 mgr.y (mgr.14138) 104 : cephadm [INF] Deploying daemon osd.1 on smithi103 2021-01-27T09:21:20.528 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:20 smithi103 bash[13570]: cluster 2021-01-27T09:21:20.149839+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:20.529 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:20 smithi103 bash[9772]: cephadm 2021-01-27T09:21:19.193160+0000 mgr.y (mgr.14138) 104 : cephadm [INF] Deploying daemon osd.1 on smithi103 2021-01-27T09:21:20.529 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:20 smithi103 bash[9772]: cluster 2021-01-27T09:21:20.149839+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:20.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:20 smithi047 bash[9721]: cephadm 2021-01-27T09:21:19.193160+0000 mgr.y (mgr.14138) 104 : cephadm [INF] Deploying daemon osd.1 on smithi103 2021-01-27T09:21:20.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:20 smithi047 bash[9721]: cluster 2021-01-27T09:21:20.149839+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:21.738 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.735+0000 7f25f2ffd700 1 -- 172.21.15.103:0/2192130462 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f25fc027200 con 0x7f25dc05bc30 2021-01-27T09:21:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 1 on host 'smithi103' 2021-01-27T09:21:21.740 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 msgr2=0x7f25dc05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:21.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 0x7f25dc05e0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f25ec004c40 tx=0x7f25ec00b040).stop 2021-01-27T09:21:21.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 msgr2=0x7f25fc10bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:21.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc10bcd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f25e400ea90 tx=0x7f25e400b040).stop 2021-01-27T09:21:21.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 shutdown_connections 2021-01-27T09:21:21.742 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> v2:172.21.15.103:6800/3303543367 conn(0x7f25dc05bc30 0x7f25dc05e0f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:21.742 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25fc0f92c0 0x7f25fc10cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:21.742 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f25fc05f7f0 0x7f25fc10bcd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:21.742 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 --2- 172.21.15.103:0/2192130462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25fc0f6810 0x7f25fc10c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:21.742 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 >> 172.21.15.103:0/2192130462 conn(0x7f25fc0effe0 msgr2=0x7f25fc0f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:21:21.743 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 shutdown_connections 2021-01-27T09:21:21.743 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:21.739+0000 7f25fb59e700 1 -- 172.21.15.103:0/2192130462 wait complete. 2021-01-27T09:21:21.828 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:21 smithi103 bash[13570]: audit 2021-01-27T09:21:21.734566+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:21.829 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:21 smithi103 bash[13570]: audit 2021-01-27T09:21:21.739202+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:21.829 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:21 smithi103 bash[9772]: audit 2021-01-27T09:21:21.734566+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:21.829 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:21 smithi103 bash[9772]: audit 2021-01-27T09:21:21.739202+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:22.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:21 smithi047 bash[9721]: audit 2021-01-27T09:21:21.734566+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:22.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:21 smithi047 bash[9721]: audit 2021-01-27T09:21:21.739202+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:23.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:22 smithi047 bash[9721]: cluster 2021-01-27T09:21:22.150403+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:23.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:22 smithi047 bash[9721]: audit 2021-01-27T09:21:22.717901+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:23.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:22 smithi047 bash[9721]: audit 2021-01-27T09:21:22.719641+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:23.093 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[13570]: cluster 2021-01-27T09:21:22.150403+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:23.094 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[13570]: audit 2021-01-27T09:21:22.717901+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:23.094 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[13570]: audit 2021-01-27T09:21:22.719641+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:23.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[9772]: cluster 2021-01-27T09:21:22.150403+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:23.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[9772]: audit 2021-01-27T09:21:22.717901+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:23.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:22 smithi103 bash[9772]: audit 2021-01-27T09:21:22.719641+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:23.121 DEBUG:teuthology.orchestra.run.smithi103:osd.1> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.1.service 2021-01-27T09:21:23.123 INFO:tasks.cephadm:Deploying osd.2 on smithi103 with /dev/vg_nvme/lv_2... 2021-01-27T09:21:23.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T09:21:23.164 INFO:journalctl@ceph.osd.1.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:21:24.526 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[9772]: cluster 2021-01-27T09:21:24.150962+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:24.526 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[13570]: cluster 2021-01-27T09:21:24.150962+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:24.526 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T09:21:24.527 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-01-27T09:21:24.527 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-01-27T09:21:24.527 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-01-27T09:21:24.527 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T09:21:24.528 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T09:21:24.528 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:24 smithi103 bash[18813]: --> ceph-volume lvm activate successful for osd ID: 1 2021-01-27T09:21:24.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:24 smithi047 bash[9721]: cluster 2021-01-27T09:21:24.150962+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:26.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:26 smithi047 bash[9721]: cluster 2021-01-27T09:21:26.151597+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:26.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:26 smithi103 bash[9772]: cluster 2021-01-27T09:21:26.151597+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:26.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:26 smithi103 bash[13570]: cluster 2021-01-27T09:21:26.151597+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:28.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[9772]: cluster 2021-01-27T09:21:28.152155+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:28.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[13570]: cluster 2021-01-27T09:21:28.152155+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:28.391 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 msgr2=0x5606c1edbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:21:28.392 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 msgr2=0x5606c1edbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:21:28.392 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_read_frame_preamble_main r=0 2021-01-27T09:21:28.392 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_MESSAGE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).throttle_message 2021-01-27T09:21:28.392 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_BYTES pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).throttle_bytes 2021-01-27T09:21:28.393 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).throttle_dispatch_queue 2021-01-27T09:21:28.393 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).read_frame_segment seg_idx=0 2021-01-27T09:21:28.393 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).read_frame_segment seg_idx=1 2021-01-27T09:21:28.393 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 msgr2=0x5606c1edbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:21:28.393 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_read_frame_segment r=0 2021-01-27T09:21:28.394 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 msgr2=0x5606c1edbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:21:28.394 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_read_frame_epilogue_main r=0 2021-01-27T09:21:28.394 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 10 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_read_frame_dispatch tag=17 2021-01-27T09:21:28.394 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_message 2021-01-27T09:21:28.394 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.159+0000 7f4c28c6f700 5 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T09:21:28.395 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c28c6f700 5 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).handle_message received message m=0x5606c1ef04e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:21:28.395 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 queue 0x5606c1ef04e0 prio 196 2021-01-27T09:21:28.395 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c28c6f700 20 --2- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 0x5606c1edbe00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x5606c1eebe60 tx=0x5606c1f20d80).read_frame 2021-01-27T09:21:28.395 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c28c6f700 20 -- 172.21.15.103:0/2439880699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606c1f6f000 msgr2=0x5606c1edbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:21:28.395 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c2846e700 1 -- 172.21.15.103:0/2439880699 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606c1ef04e0 con 0x5606c1f6f000 2021-01-27T09:21:28.396 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c2846e700 10 -- 172.21.15.103:0/2439880699 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:21:28.396 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.163+0000 7f4c2846e700 20 -- 172.21.15.103:0/2439880699 done calling dispatch on 0x5606c1ef04e0 2021-01-27T09:21:28.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:28 smithi047 bash[9721]: cluster 2021-01-27T09:21:28.152155+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:29.047 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:28 smithi103 bash[19187]: debug 2021-01-27T09:21:28.699+0000 7f4c2fef9200 -1 Falling back to public interface 2021-01-27T09:21:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T09:21:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T09:21:29.676 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2021-01-27T09:21:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2021-01-27T09:21:29.676 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.019032 s, 551 MB/s 2021-01-27T09:21:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2021-01-27T09:21:30.443 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2021-01-27T09:21:30.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:30 smithi103 bash[13570]: cluster 2021-01-27T09:21:30.152919+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:30.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:30 smithi103 bash[9772]: cluster 2021-01-27T09:21:30.152919+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:30.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:30 smithi047 bash[9721]: cluster 2021-01-27T09:21:30.152919+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:31.963 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:31 smithi103 bash[13570]: audit 2021-01-27T09:21:31.689997+0000 mon.a (mon.0) 295 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T09:21:31.963 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:31 smithi103 bash[19187]: debug 2021-01-27T09:21:31.679+0000 7f4c2fef9200 -1 osd.1 0 log_to_monitors {default=true} 2021-01-27T09:21:31.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:31 smithi103 bash[9772]: audit 2021-01-27T09:21:31.689997+0000 mon.a (mon.0) 295 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T09:21:32.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:31 smithi047 bash[9721]: audit 2021-01-27T09:21:31.689997+0000 mon.a (mon.0) 295 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T09:21:33.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:31.750297+0000 mon.a (mon.0) 296 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T09:21:33.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: cluster 2021-01-27T09:21:31.750483+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T09:21:33.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:31.751311+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:31.752492+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:33.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:31.854540+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: cluster 2021-01-27T09:21:32.153649+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:32.238351+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:32.644490+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:32.651305+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:32.751481+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:33.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: cluster 2021-01-27T09:21:32.751682+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T09:21:33.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:32 smithi047 bash[9721]: audit 2021-01-27T09:21:32.751925+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.140 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[19187]: debug 2021-01-27T09:21:32.755+0000 7f4c2646a700 -1 osd.1 0 waiting for initial osdmap 2021-01-27T09:21:33.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:31.750297+0000 mon.a (mon.0) 296 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T09:21:33.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: cluster 2021-01-27T09:21:31.750483+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T09:21:33.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:31.751311+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:31.752492+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:33.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:31.854540+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:33.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: cluster 2021-01-27T09:21:32.153649+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:33.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:32.238351+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:32.644490+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:32.651305+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:32.751481+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:33.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: cluster 2021-01-27T09:21:32.751682+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T09:21:33.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[13570]: audit 2021-01-27T09:21:32.751925+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:31.750297+0000 mon.a (mon.0) 296 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T09:21:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: cluster 2021-01-27T09:21:31.750483+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T09:21:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:31.751311+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:31.752492+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:21:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:31.854540+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: cluster 2021-01-27T09:21:32.153649+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:32.238351+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:32.644490+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:32.651305+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:32.751481+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.103:6805/2521419055' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:21:33.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: cluster 2021-01-27T09:21:32.751682+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T09:21:33.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:32 smithi103 bash[9772]: audit 2021-01-27T09:21:32.751925+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- 172.21.15.103:0/3220498925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e005fb40 msgr2=0x7fa7e00faac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3220498925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e005fb40 0x7fa7e00faac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa7d8009dc0 tx=0x7fa7d8004d10).stop 2021-01-27T09:21:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- 172.21.15.103:0/3220498925 shutdown_connections 2021-01-27T09:21:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3220498925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 0x7fa7e00ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3220498925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e005fb40 0x7fa7e00faac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3220498925 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e00fafb0 0x7fa7e00fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- 172.21.15.103:0/3220498925 >> 172.21.15.103:0/3220498925 conn(0x7fa7e00f0160 msgr2=0x7fa7e00f2580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:21:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- 172.21.15.103:0/3220498925 shutdown_connections 2021-01-27T09:21:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- 172.21.15.103:0/3220498925 wait complete. 2021-01-27T09:21:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 Processor -- start 2021-01-27T09:21:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- start start 2021-01-27T09:21:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 0x7fa7e0108070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 0x7fa7e010f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e010f640 con 0x7fa7e00fd890 2021-01-27T09:21:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e010f780 con 0x7fa7e00fafb0 2021-01-27T09:21:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e6443700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e010f8c0 con 0x7fa7e005fb40 2021-01-27T09:21:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 0x7fa7e0108070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:60504/0 (socket says 172.21.15.103:60504) 2021-01-27T09:21:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7dffff700 1 -- 172.21.15.103:0/3976497426 learned_addr learned my addr 172.21.15.103:0/3976497426 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:21:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7e49e0700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 0x7fa7e010f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 -- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 msgr2=0x7fa7e0107b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 -- 172.21.15.103:0/3976497426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 msgr2=0x7fa7e010f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 0x7fa7e010f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7df7fe700 1 -- 172.21.15.103:0/3976497426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e010fa80 con 0x7fa7e00fafb0 2021-01-27T09:21:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.907+0000 7fa7dffff700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:21:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7df7fe700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 0x7fa7e0108070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa7e005f910 tx=0x7fa7c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:21:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800eea0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e010fcd0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fa7c800f040 con 0x7fa7e00fafb0 2021-01-27T09:21:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01101b0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800c5f0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e005e6a0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fa7c80092e0 con 0x7fa7e00fafb0 2021-01-27T09:21:33.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 --2- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 0x7fa7cc05e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:21:33.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.911+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2176+0+0 (secure 0 0 0) 0x7fa7c8074910 con 0x7fa7e00fafb0 2021-01-27T09:21:33.918 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.915+0000 7fa7dffff700 1 --2- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 0x7fa7cc05e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:21:33.919 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.915+0000 7fa7dffff700 1 --2- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 0x7fa7cc05e1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa7d8003380 tx=0x7fa7d8004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:21:33.919 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:33.919+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fa7c80468c0 con 0x7fa7e00fafb0 2021-01-27T09:21:34.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:33 smithi047 bash[9721]: cephadm 2021-01-27T09:21:32.239029+0000 mgr.y (mgr.14138) 112 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:21:34.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:33 smithi047 bash[9721]: cephadm 2021-01-27T09:21:32.645629+0000 mgr.y (mgr.14138) 113 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:33 smithi047 bash[9721]: cephadm 2021-01-27T09:21:32.652186+0000 mgr.y (mgr.14138) 114 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:33 smithi047 bash[9721]: audit 2021-01-27T09:21:32.762061+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:34.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:34.107+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7e0102940 con 0x7fa7cc05bce0 2021-01-27T09:21:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[9772]: cephadm 2021-01-27T09:21:32.239029+0000 mgr.y (mgr.14138) 112 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:21:34.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[9772]: cephadm 2021-01-27T09:21:32.645629+0000 mgr.y (mgr.14138) 113 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[9772]: cephadm 2021-01-27T09:21:32.652186+0000 mgr.y (mgr.14138) 114 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[9772]: audit 2021-01-27T09:21:32.762061+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:34.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[13570]: cephadm 2021-01-27T09:21:32.239029+0000 mgr.y (mgr.14138) 112 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:21:34.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[13570]: cephadm 2021-01-27T09:21:32.645629+0000 mgr.y (mgr.14138) 113 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[13570]: cephadm 2021-01-27T09:21:32.652186+0000 mgr.y (mgr.14138) 114 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:21:34.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:33 smithi103 bash[13570]: audit 2021-01-27T09:21:32.762061+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cluster 2021-01-27T09:21:32.644479+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:35.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cluster 2021-01-27T09:21:32.644774+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:35.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:33.765303+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cluster 2021-01-27T09:21:33.772045+0000 mon.a (mon.0) 309 : cluster [INF] osd.1 v2:172.21.15.103:6805/2521419055 boot 2021-01-27T09:21:35.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cluster 2021-01-27T09:21:33.772104+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T09:21:35.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:33.772482+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:34.115108+0000 mgr.y (mgr.14138) 115 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:35.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:34.117105+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:35.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cephadm 2021-01-27T09:21:34.119412+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:35.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:34.119733+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:35.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:34.120936+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:35.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: audit 2021-01-27T09:21:34.122301+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:35.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:34 smithi047 bash[9721]: cluster 2021-01-27T09:21:34.154026+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:35.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cluster 2021-01-27T09:21:32.644479+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:35.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cluster 2021-01-27T09:21:32.644774+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:35.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:33.765303+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cluster 2021-01-27T09:21:33.772045+0000 mon.a (mon.0) 309 : cluster [INF] osd.1 v2:172.21.15.103:6805/2521419055 boot 2021-01-27T09:21:35.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cluster 2021-01-27T09:21:33.772104+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T09:21:35.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:33.772482+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:34.115108+0000 mgr.y (mgr.14138) 115 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:35.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:34.117105+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:35.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cephadm 2021-01-27T09:21:34.119412+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:35.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:34.119733+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:35.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:34.120936+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:35.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: audit 2021-01-27T09:21:34.122301+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:35.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[13570]: cluster 2021-01-27T09:21:34.154026+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:35.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cluster 2021-01-27T09:21:32.644479+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:21:35.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cluster 2021-01-27T09:21:32.644774+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:21:35.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:33.765303+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cluster 2021-01-27T09:21:33.772045+0000 mon.a (mon.0) 309 : cluster [INF] osd.1 v2:172.21.15.103:6805/2521419055 boot 2021-01-27T09:21:35.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cluster 2021-01-27T09:21:33.772104+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T09:21:35.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:33.772482+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T09:21:35.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:34.115108+0000 mgr.y (mgr.14138) 115 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:21:35.151 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:34.117105+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:21:35.151 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cephadm 2021-01-27T09:21:34.119412+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:21:35.152 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:34.119733+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:21:35.152 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:34.120936+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:35.152 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: audit 2021-01-27T09:21:34.122301+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:35.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:34 smithi103 bash[9772]: cluster 2021-01-27T09:21:34.154026+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-01-27T09:21:35.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:35 smithi103 bash[9772]: cluster 2021-01-27T09:21:34.777281+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T09:21:35.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:35 smithi103 bash[13570]: cluster 2021-01-27T09:21:34.777281+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T09:21:36.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:35 smithi047 bash[9721]: cluster 2021-01-27T09:21:34.777281+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T09:21:37.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:36 smithi047 bash[9721]: cluster 2021-01-27T09:21:36.154562+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:37.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:36 smithi103 bash[9772]: cluster 2021-01-27T09:21:36.154562+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:37.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:36 smithi103 bash[13570]: cluster 2021-01-27T09:21:36.154562+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:38.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: cluster 2021-01-27T09:21:38.155085+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:38.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: audit 2021-01-27T09:21:38.194663+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.103:0/1547491889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: audit 2021-01-27T09:21:38.195358+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: audit 2021-01-27T09:21:38.200854+0000 mon.a (mon.0) 318 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]': finished 2021-01-27T09:21:38.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: cluster 2021-01-27T09:21:38.200916+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T09:21:38.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:38 smithi047 bash[9721]: audit 2021-01-27T09:21:38.201003+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:21:38.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: cluster 2021-01-27T09:21:38.155085+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: audit 2021-01-27T09:21:38.194663+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.103:0/1547491889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: audit 2021-01-27T09:21:38.195358+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: audit 2021-01-27T09:21:38.200854+0000 mon.a (mon.0) 318 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]': finished 2021-01-27T09:21:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: cluster 2021-01-27T09:21:38.200916+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T09:21:38.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[13570]: audit 2021-01-27T09:21:38.201003+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:21:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: cluster 2021-01-27T09:21:38.155085+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: audit 2021-01-27T09:21:38.194663+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.103:0/1547491889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: audit 2021-01-27T09:21:38.195358+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]: dispatch 2021-01-27T09:21:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: audit 2021-01-27T09:21:38.200854+0000 mon.a (mon.0) 318 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea23a69b-462d-45da-ba68-854ae5a3f421"}]': finished 2021-01-27T09:21:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: cluster 2021-01-27T09:21:38.200916+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T09:21:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:38 smithi103 bash[9772]: audit 2021-01-27T09:21:38.201003+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:21:39.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:39 smithi047 bash[9721]: audit 2021-01-27T09:21:38.869180+0000 mon.a (mon.0) 321 : audit [DBG] from='client.? 172.21.15.103:0/1263461219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:39.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:39 smithi103 bash[9772]: audit 2021-01-27T09:21:38.869180+0000 mon.a (mon.0) 321 : audit [DBG] from='client.? 172.21.15.103:0/1263461219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:39.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:39 smithi103 bash[13570]: audit 2021-01-27T09:21:38.869180+0000 mon.a (mon.0) 321 : audit [DBG] from='client.? 172.21.15.103:0/1263461219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:21:40.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:40 smithi047 bash[9721]: cluster 2021-01-27T09:21:40.155663+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:40.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:40 smithi103 bash[9772]: cluster 2021-01-27T09:21:40.155663+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:40.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:40 smithi103 bash[13570]: cluster 2021-01-27T09:21:40.155663+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:41.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:41 smithi047 bash[9721]: cluster 2021-01-27T09:21:40.255689+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T09:21:41.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:41 smithi047 bash[9721]: cluster 2021-01-27T09:21:40.255752+0000 mon.a (mon.0) 323 : cluster [INF] Cluster is now healthy 2021-01-27T09:21:41.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:41 smithi103 bash[9772]: cluster 2021-01-27T09:21:40.255689+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T09:21:41.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:41 smithi103 bash[9772]: cluster 2021-01-27T09:21:40.255752+0000 mon.a (mon.0) 323 : cluster [INF] Cluster is now healthy 2021-01-27T09:21:41.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:41 smithi103 bash[13570]: cluster 2021-01-27T09:21:40.255689+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T09:21:41.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:41 smithi103 bash[13570]: cluster 2021-01-27T09:21:40.255752+0000 mon.a (mon.0) 323 : cluster [INF] Cluster is now healthy 2021-01-27T09:21:42.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:42 smithi047 bash[9721]: audit 2021-01-27T09:21:42.112447+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:42.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:42 smithi047 bash[9721]: cluster 2021-01-27T09:21:42.156218+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:42.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:42 smithi103 bash[9772]: audit 2021-01-27T09:21:42.112447+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:42.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:42 smithi103 bash[9772]: cluster 2021-01-27T09:21:42.156218+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:42.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:42 smithi103 bash[13570]: audit 2021-01-27T09:21:42.112447+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:42.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:42 smithi103 bash[13570]: cluster 2021-01-27T09:21:42.156218+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:44.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:44 smithi047 bash[9721]: cluster 2021-01-27T09:21:44.156728+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:44.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:44 smithi103 bash[13570]: cluster 2021-01-27T09:21:44.156728+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:44.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:44 smithi103 bash[9772]: cluster 2021-01-27T09:21:44.156728+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:46.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:46 smithi047 bash[9721]: cluster 2021-01-27T09:21:46.157314+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:46.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:46 smithi103 bash[9772]: cluster 2021-01-27T09:21:46.157314+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:46.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:46 smithi103 bash[13570]: cluster 2021-01-27T09:21:46.157314+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:47.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:47 smithi047 bash[9721]: audit 2021-01-27T09:21:46.376263+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T09:21:47.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:47 smithi047 bash[9721]: audit 2021-01-27T09:21:46.377689+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:47.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:47 smithi047 bash[9721]: cephadm 2021-01-27T09:21:46.378727+0000 mgr.y (mgr.14138) 124 : cephadm [INF] Deploying daemon osd.2 on smithi103 2021-01-27T09:21:47.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:47 smithi047 bash[9721]: audit 2021-01-27T09:21:46.379276+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T09:21:47.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[9772]: audit 2021-01-27T09:21:46.376263+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T09:21:47.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[9772]: audit 2021-01-27T09:21:46.377689+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:47.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[9772]: cephadm 2021-01-27T09:21:46.378727+0000 mgr.y (mgr.14138) 124 : cephadm [INF] Deploying daemon osd.2 on smithi103 2021-01-27T09:21:47.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[9772]: audit 2021-01-27T09:21:46.379276+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T09:21:47.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[13570]: audit 2021-01-27T09:21:46.376263+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T09:21:47.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[13570]: audit 2021-01-27T09:21:46.377689+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:21:47.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[13570]: cephadm 2021-01-27T09:21:46.378727+0000 mgr.y (mgr.14138) 124 : cephadm [INF] Deploying daemon osd.2 on smithi103 2021-01-27T09:21:47.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:47 smithi103 bash[13570]: audit 2021-01-27T09:21:46.379276+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T09:21:48.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:48 smithi047 bash[9721]: cluster 2021-01-27T09:21:48.157858+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:48.559 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:48 smithi103 bash[9772]: cluster 2021-01-27T09:21:48.157858+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:48.559 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:48 smithi103 bash[13570]: cluster 2021-01-27T09:21:48.157858+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:48.963 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.959+0000 7fa7dcff9700 1 -- 172.21.15.103:0/3976497426 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa7e0102940 con 0x7fa7cc05bce0 2021-01-27T09:21:48.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 msgr2=0x7fa7cc05e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:48.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 0x7fa7cc05e1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa7d8003380 tx=0x7fa7d8004d10).stop 2021-01-27T09:21:48.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 msgr2=0x7fa7e0108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:21:48.965 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 0x7fa7e0108070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa7e005f910 tx=0x7fa7c800b040).stop 2021-01-27T09:21:48.965 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 2 on host 'smithi103' 2021-01-27T09:21:48.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 shutdown_connections 2021-01-27T09:21:48.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa7cc05bce0 0x7fa7cc05e1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:48.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7e00fd890 0x7fa7e010f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:48.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7e005fb40 0x7fa7e0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:48.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 --2- 172.21.15.103:0/3976497426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7e00fafb0 0x7fa7e0108070 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:21:48.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 >> 172.21.15.103:0/3976497426 conn(0x7fa7e00f0160 msgr2=0x7fa7e00fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:21:48.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.963+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 shutdown_connections 2021-01-27T09:21:48.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:21:48.967+0000 7fa7e6443700 1 -- 172.21.15.103:0/3976497426 wait complete. 2021-01-27T09:21:49.382 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:49 smithi103 bash[9772]: audit 2021-01-27T09:21:48.958009+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:49.382 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:49 smithi103 bash[9772]: audit 2021-01-27T09:21:48.961913+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:49.382 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:49 smithi103 bash[13570]: audit 2021-01-27T09:21:48.958009+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:49.383 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:49 smithi103 bash[13570]: audit 2021-01-27T09:21:48.961913+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:49.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:49 smithi047 bash[9721]: audit 2021-01-27T09:21:48.958009+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:49.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:49 smithi047 bash[9721]: audit 2021-01-27T09:21:48.961913+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:50.421 DEBUG:teuthology.orchestra.run.smithi103:osd.2> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.2.service 2021-01-27T09:21:50.423 INFO:tasks.cephadm:Deploying osd.3 on smithi103 with /dev/vg_nvme/lv_1... 2021-01-27T09:21:50.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T09:21:50.457 INFO:journalctl@ceph.osd.2.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:21:51.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[9772]: audit 2021-01-27T09:21:50.051240+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:51.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[9772]: audit 2021-01-27T09:21:50.052580+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:51.452 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[9772]: cluster 2021-01-27T09:21:50.158405+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:51.452 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[13570]: audit 2021-01-27T09:21:50.051240+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:51.452 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[13570]: audit 2021-01-27T09:21:50.052580+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:51.453 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[13570]: cluster 2021-01-27T09:21:50.158405+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:51.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:51 smithi047 bash[9721]: audit 2021-01-27T09:21:50.051240+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:21:51.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:51 smithi047 bash[9721]: audit 2021-01-27T09:21:50.052580+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:21:51.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:51 smithi047 bash[9721]: cluster 2021-01-27T09:21:50.158405+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:52.140 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T09:21:52.140 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-01-27T09:21:52.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-01-27T09:21:52.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-01-27T09:21:52.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T09:21:52.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T09:21:52.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:51 smithi103 bash[21331]: --> ceph-volume lvm activate successful for osd ID: 2 2021-01-27T09:21:52.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:52 smithi047 bash[9721]: cluster 2021-01-27T09:21:52.158902+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:52.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:52 smithi103 bash[9772]: cluster 2021-01-27T09:21:52.158902+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:52.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:52 smithi103 bash[13570]: cluster 2021-01-27T09:21:52.158902+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:54.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:54 smithi047 bash[9721]: cluster 2021-01-27T09:21:54.159514+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:54.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:54 smithi103 bash[13570]: cluster 2021-01-27T09:21:54.159514+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:54.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:54 smithi103 bash[9772]: cluster 2021-01-27T09:21:54.159514+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:56.140 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 msgr2=0x562d74d00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:21:56.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 msgr2=0x562d74d00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:21:56.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_read_frame_preamble_main r=0 2021-01-27T09:21:56.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_MESSAGE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).throttle_message 2021-01-27T09:21:56.141 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_BYTES pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).throttle_bytes 2021-01-27T09:21:56.142 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).throttle_dispatch_queue 2021-01-27T09:21:56.142 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).read_frame_segment seg_idx=0 2021-01-27T09:21:56.142 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).read_frame_segment seg_idx=1 2021-01-27T09:21:56.142 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 msgr2=0x562d74d00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:21:56.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_read_frame_segment r=0 2021-01-27T09:21:56.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 msgr2=0x562d74d00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:21:56.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_read_frame_epilogue_main r=0 2021-01-27T09:21:56.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 10 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_read_frame_dispatch tag=17 2021-01-27T09:21:56.143 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_message 2021-01-27T09:21:56.144 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 5 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T09:21:56.144 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 5 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).handle_message received message m=0x562d74d144e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:21:56.144 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 queue 0x562d74d144e0 prio 196 2021-01-27T09:21:56.144 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 --2- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 0x562d74d00300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x562d74d0fe60 tx=0x562d74d44d80).read_frame 2021-01-27T09:21:56.144 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d305b4700 20 -- 172.21.15.103:0/328945231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d74d93400 msgr2=0x562d74d00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:21:56.145 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d2edb1700 1 -- 172.21.15.103:0/328945231 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d74d144e0 con 0x562d74d93400 2021-01-27T09:21:56.145 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d2edb1700 10 -- 172.21.15.103:0/328945231 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:21:56.145 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:55 smithi103 bash[21682]: debug 2021-01-27T09:21:55.799+0000 7f1d2edb1700 20 -- 172.21.15.103:0/328945231 done calling dispatch on 0x562d74d144e0 2021-01-27T09:21:56.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:56 smithi047 bash[9721]: cluster 2021-01-27T09:21:56.160088+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:56.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:56 smithi103 bash[13570]: cluster 2021-01-27T09:21:56.160088+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:56.640 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:56 smithi103 bash[21682]: debug 2021-01-27T09:21:56.335+0000 7f1d3683c200 -1 Falling back to public interface 2021-01-27T09:21:56.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:56 smithi103 bash[9772]: cluster 2021-01-27T09:21:56.160088+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T09:21:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T09:21:57.649 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2021-01-27T09:21:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2021-01-27T09:21:57.650 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0165292 s, 634 MB/s 2021-01-27T09:21:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2021-01-27T09:21:58.382 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:58 smithi103 bash[9772]: cluster 2021-01-27T09:21:58.160644+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:58.383 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:21:58 smithi103 bash[10018]: debug 2021-01-27T09:21:58.131+0000 7ff947184700 -1 calc_pg_upmaps abort due to max <= 0 2021-01-27T09:21:58.383 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:58 smithi103 bash[13570]: cluster 2021-01-27T09:21:58.160644+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:58.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2021-01-27T09:21:58.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:58 smithi047 bash[9721]: cluster 2021-01-27T09:21:58.160644+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:21:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:59 smithi047 bash[9721]: audit 2021-01-27T09:21:58.322472+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:21:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:59 smithi047 bash[9721]: audit 2021-01-27T09:21:58.323444+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:21:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:21:59 smithi047 bash[9721]: audit 2021-01-27T09:21:59.227035+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:59.640 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[21682]: debug 2021-01-27T09:21:59.379+0000 7f1d3683c200 -1 osd.2 0 log_to_monitors {default=true} 2021-01-27T09:21:59.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[9772]: audit 2021-01-27T09:21:58.322472+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:21:59.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[9772]: audit 2021-01-27T09:21:58.323444+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:21:59.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[9772]: audit 2021-01-27T09:21:59.227035+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:21:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[13570]: audit 2021-01-27T09:21:58.322472+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:21:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[13570]: audit 2021-01-27T09:21:58.323444+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:21:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:21:59 smithi103 bash[13570]: audit 2021-01-27T09:21:59.227035+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:00.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: audit 2021-01-27T09:21:59.387832+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T09:22:00.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: audit 2021-01-27T09:21:59.599474+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: audit 2021-01-27T09:21:59.604713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: cephadm 2021-01-27T09:21:59.605668+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: cephadm 2021-01-27T09:21:59.607312+0000 mgr.y (mgr.14138) 132 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:22:00.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: audit 2021-01-27T09:22:00.048506+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: cephadm 2021-01-27T09:22:00.050324+0000 mgr.y (mgr.14138) 133 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.392 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[9772]: cluster 2021-01-27T09:22:00.161229+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:00.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: audit 2021-01-27T09:21:59.387832+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T09:22:00.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: audit 2021-01-27T09:21:59.599474+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: audit 2021-01-27T09:21:59.604713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: cephadm 2021-01-27T09:21:59.605668+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: cephadm 2021-01-27T09:21:59.607312+0000 mgr.y (mgr.14138) 132 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:22:00.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: audit 2021-01-27T09:22:00.048506+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: cephadm 2021-01-27T09:22:00.050324+0000 mgr.y (mgr.14138) 133 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:00 smithi103 bash[13570]: cluster 2021-01-27T09:22:00.161229+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:00.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: audit 2021-01-27T09:21:59.387832+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T09:22:00.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: audit 2021-01-27T09:21:59.599474+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: audit 2021-01-27T09:21:59.604713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: cephadm 2021-01-27T09:21:59.605668+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: cephadm 2021-01-27T09:21:59.607312+0000 mgr.y (mgr.14138) 132 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:22:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: audit 2021-01-27T09:22:00.048506+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: cephadm 2021-01-27T09:22:00.050324+0000 mgr.y (mgr.14138) 133 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:00.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:00 smithi047 bash[9721]: cluster 2021-01-27T09:22:00.161229+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:01.534 INFO:journalctl@ceph.osd.2.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[21682]: debug 2021-01-27T09:22:01.275+0000 7f1d2cdad700 -1 osd.2 0 waiting for initial osdmap 2021-01-27T09:22:01.534 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: audit 2021-01-27T09:22:00.267529+0000 mon.a (mon.0) 339 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T09:22:01.535 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: cluster 2021-01-27T09:22:00.267711+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T09:22:01.535 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: audit 2021-01-27T09:22:00.268700+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.535 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: audit 2021-01-27T09:22:00.270552+0000 mon.a (mon.0) 342 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:01.536 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: audit 2021-01-27T09:22:01.270224+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:01.536 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: cluster 2021-01-27T09:22:01.270411+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T09:22:01.537 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[9772]: audit 2021-01-27T09:22:01.270787+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.537 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: audit 2021-01-27T09:22:00.267529+0000 mon.a (mon.0) 339 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T09:22:01.537 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: cluster 2021-01-27T09:22:00.267711+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T09:22:01.538 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: audit 2021-01-27T09:22:00.268700+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.538 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: audit 2021-01-27T09:22:00.270552+0000 mon.a (mon.0) 342 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:01.538 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: audit 2021-01-27T09:22:01.270224+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:01.538 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: cluster 2021-01-27T09:22:01.270411+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T09:22:01.538 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:01 smithi103 bash[13570]: audit 2021-01-27T09:22:01.270787+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: audit 2021-01-27T09:22:00.267529+0000 mon.a (mon.0) 339 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T09:22:01.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: cluster 2021-01-27T09:22:00.267711+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T09:22:01.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: audit 2021-01-27T09:22:00.268700+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: audit 2021-01-27T09:22:00.270552+0000 mon.a (mon.0) 342 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:01.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: audit 2021-01-27T09:22:01.270224+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 v2:172.21.15.103:6809/3547869492' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:01.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: cluster 2021-01-27T09:22:01.270411+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T09:22:01.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:01 smithi047 bash[9721]: audit 2021-01-27T09:22:01.270787+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2030506835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f3ed0 msgr2=0x7fdb6c0f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2030506835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f3ed0 0x7fdb6c0f42f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdb5c004e00 tx=0x7fdb5c00ac40).stop 2021-01-27T09:22:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2030506835 shutdown_connections 2021-01-27T09:22:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2030506835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c0fc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2030506835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f3ed0 0x7fdb6c0f42f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2030506835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f47e0 0x7fdb6c0f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2030506835 >> 172.21.15.103:0/2030506835 conn(0x7fdb6c0ef6d0 msgr2=0x7fdb6c0f1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:22:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2030506835 shutdown_connections 2021-01-27T09:22:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2030506835 wait complete. 2021-01-27T09:22:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.659+0000 7fdb6b59e700 1 Processor -- start 2021-01-27T09:22:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- start start 2021-01-27T09:22:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f47e0 0x7fdb6c103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c103f70 con 0x7fdb6c0f58f0 2021-01-27T09:22:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1040e0 con 0x7fdb6c0f47e0 2021-01-27T09:22:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c10f7e0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:60564/0 (socket says 172.21.15.103:60564) 2021-01-27T09:22:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 -- 172.21.15.103:0/2126341503 learned_addr learned my addr 172.21.15.103:0/2126341503 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:22:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb69d9b700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f47e0 0x7fdb6c103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6ad9d700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 -- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f47e0 msgr2=0x7fdb6c103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f47e0 0x7fdb6c103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 -- 172.21.15.103:0/2126341503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 msgr2=0x7fdb6c103880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c103880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 -- 172.21.15.103:0/2126341503 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c10f9a0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6ad9d700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:22:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6a59c700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdb5c00c8c0 tx=0x7fdb5c00ac40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00f040 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c10fbf0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fdb5c004160 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c01e6d0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.679 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.663+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c10ffa0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.679 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fdb5c014620 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.679 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c0f3360 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.680 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb62ffd700 1 --2- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 0x7fdb5805e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:01.680 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2328+0+0 (secure 0 0 0) 0x7fdb5c076af0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.680 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb69d9b700 1 --2- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 0x7fdb5805e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.667+0000 7fdb69d9b700 1 --2- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 0x7fdb5805e190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdb54009fd0 tx=0x7fdb5400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:01.682 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.675+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fdb5c04a5f0 con 0x7fdb6c0f3ed0 2021-01-27T09:22:01.858 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:01.859+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb6c0fe380 con 0x7fdb5805bcd0 2021-01-27T09:22:02.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.280973+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:02.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.864920+0000 mgr.y (mgr.14138) 135 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:02.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.866872+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:02.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: cephadm 2021-01-27T09:22:01.869060+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:22:02.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.869484+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:02.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.870755+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:02.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: audit 2021-01-27T09:22:01.872358+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:02.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:02 smithi047 bash[9721]: cluster 2021-01-27T09:22:02.161701+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:02.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.280973+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:02.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.864920+0000 mgr.y (mgr.14138) 135 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:02.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.866872+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:02.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: cephadm 2021-01-27T09:22:01.869060+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:22:02.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.869484+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:02.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.870755+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:02.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: audit 2021-01-27T09:22:01.872358+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:02.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[9772]: cluster 2021-01-27T09:22:02.161701+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:02.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.280973+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:02.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.864920+0000 mgr.y (mgr.14138) 135 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:02.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.866872+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: cephadm 2021-01-27T09:22:01.869060+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Applying drive group None on host smithi103... 2021-01-27T09:22:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.869484+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.870755+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: audit 2021-01-27T09:22:01.872358+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:02 smithi103 bash[13570]: cluster 2021-01-27T09:22:02.161701+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T09:22:03.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: cluster 2021-01-27T09:22:00.398829+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:03.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: cluster 2021-01-27T09:22:00.399043+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:03.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: cluster 2021-01-27T09:22:02.285889+0000 mon.a (mon.0) 351 : cluster [INF] osd.2 v2:172.21.15.103:6809/3547869492 boot 2021-01-27T09:22:03.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: cluster 2021-01-27T09:22:02.285928+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T09:22:03.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: audit 2021-01-27T09:22:02.286593+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:03.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:03 smithi047 bash[9721]: cluster 2021-01-27T09:22:03.286189+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T09:22:03.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: cluster 2021-01-27T09:22:00.398829+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:03.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: cluster 2021-01-27T09:22:00.399043+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:03.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: cluster 2021-01-27T09:22:02.285889+0000 mon.a (mon.0) 351 : cluster [INF] osd.2 v2:172.21.15.103:6809/3547869492 boot 2021-01-27T09:22:03.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: cluster 2021-01-27T09:22:02.285928+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T09:22:03.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: audit 2021-01-27T09:22:02.286593+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:03.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[13570]: cluster 2021-01-27T09:22:03.286189+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T09:22:03.605 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: cluster 2021-01-27T09:22:00.398829+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:03.605 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: cluster 2021-01-27T09:22:00.399043+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:03.605 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: cluster 2021-01-27T09:22:02.285889+0000 mon.a (mon.0) 351 : cluster [INF] osd.2 v2:172.21.15.103:6809/3547869492 boot 2021-01-27T09:22:03.605 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: cluster 2021-01-27T09:22:02.285928+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T09:22:03.606 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: audit 2021-01-27T09:22:02.286593+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T09:22:03.606 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:03 smithi103 bash[9772]: cluster 2021-01-27T09:22:03.286189+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T09:22:04.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:04 smithi103 bash[9772]: cluster 2021-01-27T09:22:04.162381+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:04.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:04 smithi103 bash[13570]: cluster 2021-01-27T09:22:04.162381+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:04.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:04 smithi047 bash[9721]: cluster 2021-01-27T09:22:04.162381+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:06.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:05 smithi047 bash[9721]: audit 2021-01-27T09:22:05.902934+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.103:0/3011320344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:05 smithi047 bash[9721]: audit 2021-01-27T09:22:05.903601+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:05 smithi047 bash[9721]: audit 2021-01-27T09:22:05.913594+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]': finished 2021-01-27T09:22:06.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:05 smithi047 bash[9721]: cluster 2021-01-27T09:22:05.913729+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T09:22:06.297 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:05 smithi047 bash[9721]: audit 2021-01-27T09:22:05.913918+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:06.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[9772]: audit 2021-01-27T09:22:05.902934+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.103:0/3011320344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[9772]: audit 2021-01-27T09:22:05.903601+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[9772]: audit 2021-01-27T09:22:05.913594+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]': finished 2021-01-27T09:22:06.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[9772]: cluster 2021-01-27T09:22:05.913729+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T09:22:06.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[9772]: audit 2021-01-27T09:22:05.913918+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:06.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[13570]: audit 2021-01-27T09:22:05.902934+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.103:0/3011320344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[13570]: audit 2021-01-27T09:22:05.903601+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]: dispatch 2021-01-27T09:22:06.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[13570]: audit 2021-01-27T09:22:05.913594+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4cbd1716-a15a-4236-a1d4-690a914a5e55"}]': finished 2021-01-27T09:22:06.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[13570]: cluster 2021-01-27T09:22:05.913729+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T09:22:06.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:05 smithi103 bash[13570]: audit 2021-01-27T09:22:05.913918+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:07.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:06 smithi047 bash[9721]: cluster 2021-01-27T09:22:06.162916+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:07.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:06 smithi047 bash[9721]: audit 2021-01-27T09:22:06.558139+0000 mon.a (mon.0) 359 : audit [DBG] from='client.? 172.21.15.103:0/2853478339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:07.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:06 smithi103 bash[9772]: cluster 2021-01-27T09:22:06.162916+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:07.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:06 smithi103 bash[9772]: audit 2021-01-27T09:22:06.558139+0000 mon.a (mon.0) 359 : audit [DBG] from='client.? 172.21.15.103:0/2853478339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:07.390 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:06 smithi103 bash[13570]: cluster 2021-01-27T09:22:06.162916+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:07.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:06 smithi103 bash[13570]: audit 2021-01-27T09:22:06.558139+0000 mon.a (mon.0) 359 : audit [DBG] from='client.? 172.21.15.103:0/2853478339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:08.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:08 smithi047 bash[9721]: cluster 2021-01-27T09:22:08.163474+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:08.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:08 smithi103 bash[13570]: cluster 2021-01-27T09:22:08.163474+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:08.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:08 smithi103 bash[9772]: cluster 2021-01-27T09:22:08.163474+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:10.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:09 smithi047 bash[9721]: audit 2021-01-27T09:22:09.722216+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:10.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:09 smithi103 bash[13570]: audit 2021-01-27T09:22:09.722216+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:10.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:09 smithi103 bash[9772]: audit 2021-01-27T09:22:09.722216+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:11.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:10 smithi047 bash[9721]: cluster 2021-01-27T09:22:10.164193+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:11.050 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:10 smithi103 bash[13570]: cluster 2021-01-27T09:22:10.164193+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:11.050 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:10 smithi103 bash[9772]: cluster 2021-01-27T09:22:10.164193+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:12.508 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:12 smithi103 bash[13570]: cluster 2021-01-27T09:22:12.164794+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:12.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:12 smithi103 bash[9772]: cluster 2021-01-27T09:22:12.164794+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:12.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:12 smithi047 bash[9721]: cluster 2021-01-27T09:22:12.164794+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:14.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:14 smithi047 bash[9721]: audit 2021-01-27T09:22:13.827057+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T09:22:14.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:14 smithi047 bash[9721]: audit 2021-01-27T09:22:13.828563+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:14.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:14 smithi047 bash[9721]: cephadm 2021-01-27T09:22:13.829614+0000 mgr.y (mgr.14138) 143 : cephadm [INF] Deploying daemon osd.3 on smithi103 2021-01-27T09:22:14.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:14 smithi047 bash[9721]: audit 2021-01-27T09:22:13.830193+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T09:22:14.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:14 smithi047 bash[9721]: cluster 2021-01-27T09:22:14.165341+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:14.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[9772]: audit 2021-01-27T09:22:13.827057+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T09:22:14.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[9772]: audit 2021-01-27T09:22:13.828563+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:14.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[9772]: cephadm 2021-01-27T09:22:13.829614+0000 mgr.y (mgr.14138) 143 : cephadm [INF] Deploying daemon osd.3 on smithi103 2021-01-27T09:22:14.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[9772]: audit 2021-01-27T09:22:13.830193+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T09:22:14.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[9772]: cluster 2021-01-27T09:22:14.165341+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:14.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[13570]: audit 2021-01-27T09:22:13.827057+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T09:22:14.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[13570]: audit 2021-01-27T09:22:13.828563+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:14.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[13570]: cephadm 2021-01-27T09:22:13.829614+0000 mgr.y (mgr.14138) 143 : cephadm [INF] Deploying daemon osd.3 on smithi103 2021-01-27T09:22:14.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[13570]: audit 2021-01-27T09:22:13.830193+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T09:22:14.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:14 smithi103 bash[13570]: cluster 2021-01-27T09:22:14.165341+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 3 on host 'smithi103' 2021-01-27T09:22:16.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.411+0000 7fdb62ffd700 1 -- 172.21.15.103:0/2126341503 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdb6c0fe380 con 0x7fdb5805bcd0 2021-01-27T09:22:16.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 msgr2=0x7fdb5805e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:16.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 0x7fdb5805e190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdb54009fd0 tx=0x7fdb5400b040).stop 2021-01-27T09:22:16.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 msgr2=0x7fdb6c104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:16.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdb5c00c8c0 tx=0x7fdb5c00ac40).stop 2021-01-27T09:22:16.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 shutdown_connections 2021-01-27T09:22:16.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdb5805bcd0 0x7fdb5805e190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:16.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb6c0f58f0 0x7fdb6c103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:16.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb6c0f3ed0 0x7fdb6c104db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:16.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 --2- 172.21.15.103:0/2126341503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb6c0f47e0 0x7fdb6c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:16.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 >> 172.21.15.103:0/2126341503 conn(0x7fdb6c0ef6d0 msgr2=0x7fdb6c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:22:16.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 shutdown_connections 2021-01-27T09:22:16.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:22:16.419+0000 7fdb6b59e700 1 -- 172.21.15.103:0/2126341503 wait complete. 2021-01-27T09:22:16.500 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:16 smithi103 bash[9772]: cluster 2021-01-27T09:22:16.165803+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:16.501 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:16 smithi103 bash[13570]: cluster 2021-01-27T09:22:16.165803+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:16.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:16 smithi047 bash[9721]: cluster 2021-01-27T09:22:16.165803+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:17.239 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:17 smithi103 bash[13570]: audit 2021-01-27T09:22:16.409401+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:17.239 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:17 smithi103 bash[13570]: audit 2021-01-27T09:22:16.412300+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:17.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:17 smithi047 bash[9721]: audit 2021-01-27T09:22:16.409401+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:17.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:17 smithi047 bash[9721]: audit 2021-01-27T09:22:16.412300+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:17.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:17 smithi103 bash[9772]: audit 2021-01-27T09:22:16.409401+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:17.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:17 smithi103 bash[9772]: audit 2021-01-27T09:22:16.412300+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:17.869 DEBUG:teuthology.orchestra.run.smithi103:osd.3> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.3.service 2021-01-27T09:22:17.871 INFO:tasks.cephadm:Deploying osd.4 on smithi047 with /dev/vg_nvme/lv_4... 2021-01-27T09:22:17.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T09:22:17.891 INFO:journalctl@ceph.osd.3.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:22:19.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:18 smithi047 bash[9721]: audit 2021-01-27T09:22:17.667079+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:19.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:18 smithi047 bash[9721]: audit 2021-01-27T09:22:17.668804+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:19.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:18 smithi047 bash[9721]: cluster 2021-01-27T09:22:18.166254+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:19.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[9772]: audit 2021-01-27T09:22:17.667079+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:19.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[9772]: audit 2021-01-27T09:22:17.668804+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:19.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[9772]: cluster 2021-01-27T09:22:18.166254+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:19.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[13570]: audit 2021-01-27T09:22:17.667079+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:19.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[13570]: audit 2021-01-27T09:22:17.668804+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:19.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[13570]: cluster 2021-01-27T09:22:18.166254+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:19.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T09:22:19.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-01-27T09:22:19.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-01-27T09:22:19.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-01-27T09:22:19.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T09:22:19.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T09:22:19.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:18 smithi103 bash[23880]: --> ceph-volume lvm activate successful for osd ID: 3 2021-01-27T09:22:20.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:20 smithi047 bash[9721]: cluster 2021-01-27T09:22:20.166784+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:20.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:20 smithi103 bash[9772]: cluster 2021-01-27T09:22:20.166784+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:20.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:20 smithi103 bash[13570]: cluster 2021-01-27T09:22:20.166784+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T09:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T09:22:21.530 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2021-01-27T09:22:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2021-01-27T09:22:21.531 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0156579 s, 670 MB/s 2021-01-27T09:22:21.531 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2021-01-27T09:22:22.140 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 msgr2=0x55b28d3dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:22:22.140 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 msgr2=0x55b28d3dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:22:22.140 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_read_frame_preamble_main r=0 2021-01-27T09:22:22.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_MESSAGE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).throttle_message 2021-01-27T09:22:22.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_BYTES pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).throttle_bytes 2021-01-27T09:22:22.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).throttle_dispatch_queue 2021-01-27T09:22:22.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).read_frame_segment seg_idx=0 2021-01-27T09:22:22.141 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).read_frame_segment seg_idx=1 2021-01-27T09:22:22.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 msgr2=0x55b28d3dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:22:22.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_read_frame_segment r=0 2021-01-27T09:22:22.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 msgr2=0x55b28d3dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:22:22.142 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_read_frame_epilogue_main r=0 2021-01-27T09:22:22.143 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 10 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_read_frame_dispatch tag=17 2021-01-27T09:22:22.143 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_message 2021-01-27T09:22:22.143 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 5 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-27T09:22:22.143 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 5 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).handle_message received message m=0x55b28d3f04e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:22:22.143 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 queue 0x55b28d3f04e0 prio 196 2021-01-27T09:22:22.144 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 --2- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 0x55b28d3dbe00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x55b28d3ebe60 tx=0x55b28d4200c0).read_frame 2021-01-27T09:22:22.144 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f850700 20 -- 172.21.15.103:0/1088033345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55b28d46f000 msgr2=0x55b28d3dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:22:22.144 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f04f700 1 -- 172.21.15.103:0/1088033345 <== mon.1 v2:172.21.15.103:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b28d3f04e0 con 0x55b28d46f000 2021-01-27T09:22:22.144 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f04f700 10 -- 172.21.15.103:0/1088033345 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:22:22.144 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:21 smithi103 bash[24206]: debug 2021-01-27T09:22:21.715+0000 7fbd2f04f700 20 -- 172.21.15.103:0/1088033345 done calling dispatch on 0x55b28d3f04e0 2021-01-27T09:22:22.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2021-01-27T09:22:22.542 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:22 smithi103 bash[9772]: cluster 2021-01-27T09:22:22.167367+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:22.542 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:22 smithi103 bash[13570]: cluster 2021-01-27T09:22:22.167367+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:22.542 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:22 smithi103 bash[24206]: debug 2021-01-27T09:22:22.271+0000 7fbd36ada200 -1 Falling back to public interface 2021-01-27T09:22:22.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:22 smithi047 bash[9721]: cluster 2021-01-27T09:22:22.167367+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:24.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:24 smithi047 bash[9721]: cluster 2021-01-27T09:22:24.167952+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:24 smithi103 bash[9772]: cluster 2021-01-27T09:22:24.167952+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:24.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:24 smithi103 bash[13570]: cluster 2021-01-27T09:22:24.167952+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:25.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: audit 2021-01-27T09:22:24.534527+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:25.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: audit 2021-01-27T09:22:24.905816+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: audit 2021-01-27T09:22:24.913274+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: cephadm 2021-01-27T09:22:24.914726+0000 mgr.y (mgr.14138) 150 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: audit 2021-01-27T09:22:24.923326+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:25 smithi047 bash[9721]: cephadm 2021-01-27T09:22:24.924905+0000 mgr.y (mgr.14138) 151 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.611 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- 172.21.15.47:0/884902783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f6b40 msgr2=0x7fb8c00f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:25.611 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/884902783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f6b40 0x7fb8c00f6fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb8bc004e00 tx=0x7fb8bc009b30).stop 2021-01-27T09:22:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- 172.21.15.47:0/884902783 shutdown_connections 2021-01-27T09:22:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/884902783 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f7490 0x7fb8c00fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/884902783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f58a0 0x7fb8c00f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/884902783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f6b40 0x7fb8c00f6fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- 172.21.15.47:0/884902783 >> 172.21.15.47:0/884902783 conn(0x7fb8c00f10a0 msgr2=0x7fb8c00f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:22:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- 172.21.15.47:0/884902783 shutdown_connections 2021-01-27T09:22:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- 172.21.15.47:0/884902783 wait complete. 2021-01-27T09:22:25.615 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 Processor -- start 2021-01-27T09:22:25.615 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 -- start start 2021-01-27T09:22:25.615 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 0x7fb8c006aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:25.615 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 0x7fb8c0068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.612+0000 7fb8c64a0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0069c50 con 0x7fb8c00f7490 2021-01-27T09:22:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0069dc0 con 0x7fb8c00f6b40 2021-01-27T09:22:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c010f990 con 0x7fb8c00f58a0 2021-01-27T09:22:25.616 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37542/0 (socket says 172.21.15.47:37542) 2021-01-27T09:22:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 -- 172.21.15.47:0/4136836575 learned_addr learned my addr 172.21.15.47:0/4136836575 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:22:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c4c9d700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 0x7fb8c0068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c549e700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 0x7fb8c006aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 -- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 msgr2=0x7fb8c006aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 0x7fb8c006aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 -- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 msgr2=0x7fb8c0068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 0x7fb8c0068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 -- 172.21.15.47:0/4136836575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c010fb50 con 0x7fb8c00f7490 2021-01-27T09:22:25.619 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c4c9d700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 0x7fb8c0068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:22:25.619 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c549e700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 0x7fb8c006aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:22:25.619 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c5c9f700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb8b800ee40 tx=0x7fb8b800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:25.619 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80097d0 con 0x7fb8c00f7490 2021-01-27T09:22:25.619 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c010fe00 con 0x7fb8c00f7490 2021-01-27T09:22:25.620 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb8b800f040 con 0x7fb8c00f7490 2021-01-27T09:22:25.620 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8007620 con 0x7fb8c00f7490 2021-01-27T09:22:25.620 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c0110260 con 0x7fb8c00f7490 2021-01-27T09:22:25.621 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.616+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c00f4c90 con 0x7fb8c00f7490 2021-01-27T09:22:25.621 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.620+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fb8b8007a50 con 0x7fb8c00f7490 2021-01-27T09:22:25.622 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.620+0000 7fb8b5ffb700 1 --2- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 0x7fb8ac05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:25.622 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.620+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2583+0+0 (secure 0 0 0) 0x7fb8b8074cd0 con 0x7fb8c00f7490 2021-01-27T09:22:25.622 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.620+0000 7fb8c549e700 1 --2- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 0x7fb8ac05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:25.622 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.620+0000 7fb8c549e700 1 --2- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 0x7fb8ac05e0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8c006a820 tx=0x7fb8b000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.624+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb8b80468c0 con 0x7fb8c00f7490 2021-01-27T09:22:25.639 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[24206]: debug 2021-01-27T09:22:25.299+0000 7fbd36ada200 -1 osd.3 0 log_to_monitors {default=true} 2021-01-27T09:22:25.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: audit 2021-01-27T09:22:24.534527+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:25.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: audit 2021-01-27T09:22:24.905816+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: audit 2021-01-27T09:22:24.913274+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: cephadm 2021-01-27T09:22:24.914726+0000 mgr.y (mgr.14138) 150 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: audit 2021-01-27T09:22:24.923326+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[9772]: cephadm 2021-01-27T09:22:24.924905+0000 mgr.y (mgr.14138) 151 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: audit 2021-01-27T09:22:24.534527+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:25.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: audit 2021-01-27T09:22:24.905816+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: audit 2021-01-27T09:22:24.913274+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: cephadm 2021-01-27T09:22:24.914726+0000 mgr.y (mgr.14138) 150 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: audit 2021-01-27T09:22:24.923326+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:25.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:25 smithi103 bash[13570]: cephadm 2021-01-27T09:22:24.924905+0000 mgr.y (mgr.14138) 151 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:25.812+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c0100620 con 0x7fb8ac05bc30 2021-01-27T09:22:26.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.307543+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T09:22:26.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.817506+0000 mgr.y (mgr.14138) 152 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:26.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.819828+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:26.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: cephadm 2021-01-27T09:22:25.823371+0000 mgr.y (mgr.14138) 153 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:26.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.823932+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:26.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.825682+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:26.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: audit 2021-01-27T09:22:25.827876+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:26.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:26 smithi047 bash[9721]: cluster 2021-01-27T09:22:26.168470+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:26.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.307543+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T09:22:26.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.817506+0000 mgr.y (mgr.14138) 152 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:26.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.819828+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:26.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: cephadm 2021-01-27T09:22:25.823371+0000 mgr.y (mgr.14138) 153 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:26.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.823932+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:26.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.825682+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:26.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: audit 2021-01-27T09:22:25.827876+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:26.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[9772]: cluster 2021-01-27T09:22:26.168470+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:26.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.307543+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T09:22:26.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.817506+0000 mgr.y (mgr.14138) 152 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:26.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.819828+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:26.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: cephadm 2021-01-27T09:22:25.823371+0000 mgr.y (mgr.14138) 153 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:26.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.823932+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:26.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.825682+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:26.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: audit 2021-01-27T09:22:25.827876+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:26.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:26 smithi103 bash[13570]: cluster 2021-01-27T09:22:26.168470+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:27.639 INFO:journalctl@ceph.osd.3.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[24206]: debug 2021-01-27T09:22:27.307+0000 7fbd2d04b700 -1 osd.3 0 waiting for initial osdmap 2021-01-27T09:22:27.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[13570]: audit 2021-01-27T09:22:26.299365+0000 mon.a (mon.0) 377 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T09:22:27.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[13570]: cluster 2021-01-27T09:22:26.299479+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T09:22:27.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[13570]: audit 2021-01-27T09:22:26.299763+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:27.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[13570]: audit 2021-01-27T09:22:26.300622+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:27.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[9772]: audit 2021-01-27T09:22:26.299365+0000 mon.a (mon.0) 377 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T09:22:27.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[9772]: cluster 2021-01-27T09:22:26.299479+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T09:22:27.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[9772]: audit 2021-01-27T09:22:26.299763+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:27.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:27 smithi103 bash[9772]: audit 2021-01-27T09:22:26.300622+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:27.648 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:27 smithi047 bash[9721]: audit 2021-01-27T09:22:26.299365+0000 mon.a (mon.0) 377 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T09:22:27.649 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:27 smithi047 bash[9721]: cluster 2021-01-27T09:22:26.299479+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T09:22:27.649 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:27 smithi047 bash[9721]: audit 2021-01-27T09:22:26.299763+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:27.649 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:27 smithi047 bash[9721]: audit 2021-01-27T09:22:26.300622+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2021-01-27T09:22:28.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: cluster 2021-01-27T09:22:26.299902+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:28.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: cluster 2021-01-27T09:22:26.300076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:28.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: audit 2021-01-27T09:22:27.304531+0000 mon.a (mon.0) 381 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:28.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: cluster 2021-01-27T09:22:27.304709+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T09:22:28.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: audit 2021-01-27T09:22:27.305571+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: audit 2021-01-27T09:22:27.314433+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:28 smithi047 bash[9721]: cluster 2021-01-27T09:22:28.169024+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:28.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: cluster 2021-01-27T09:22:26.299902+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:28.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: cluster 2021-01-27T09:22:26.300076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:28.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: audit 2021-01-27T09:22:27.304531+0000 mon.a (mon.0) 381 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:28.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: cluster 2021-01-27T09:22:27.304709+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T09:22:28.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: audit 2021-01-27T09:22:27.305571+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: audit 2021-01-27T09:22:27.314433+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[9772]: cluster 2021-01-27T09:22:28.169024+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:28.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: cluster 2021-01-27T09:22:26.299902+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:28.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: cluster 2021-01-27T09:22:26.300076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:28.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: audit 2021-01-27T09:22:27.304531+0000 mon.a (mon.0) 381 : audit [INF] from='osd.3 v2:172.21.15.103:6813/3546808739' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2021-01-27T09:22:28.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: cluster 2021-01-27T09:22:27.304709+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T09:22:28.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: audit 2021-01-27T09:22:27.305571+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: audit 2021-01-27T09:22:27.314433+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:28.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:28 smithi103 bash[13570]: cluster 2021-01-27T09:22:28.169024+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T09:22:29.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:29 smithi047 bash[9721]: cluster 2021-01-27T09:22:28.317834+0000 mon.a (mon.0) 385 : cluster [INF] osd.3 v2:172.21.15.103:6813/3546808739 boot 2021-01-27T09:22:29.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:29 smithi047 bash[9721]: cluster 2021-01-27T09:22:28.318083+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T09:22:29.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:29 smithi047 bash[9721]: audit 2021-01-27T09:22:28.319365+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:29.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[9772]: cluster 2021-01-27T09:22:28.317834+0000 mon.a (mon.0) 385 : cluster [INF] osd.3 v2:172.21.15.103:6813/3546808739 boot 2021-01-27T09:22:29.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[9772]: cluster 2021-01-27T09:22:28.318083+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T09:22:29.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[9772]: audit 2021-01-27T09:22:28.319365+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:29.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[13570]: cluster 2021-01-27T09:22:28.317834+0000 mon.a (mon.0) 385 : cluster [INF] osd.3 v2:172.21.15.103:6813/3546808739 boot 2021-01-27T09:22:29.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[13570]: cluster 2021-01-27T09:22:28.318083+0000 mon.a (mon.0) 386 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T09:22:29.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:29 smithi103 bash[13570]: audit 2021-01-27T09:22:28.319365+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T09:22:30.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: cluster 2021-01-27T09:22:29.339918+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T09:22:30.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: audit 2021-01-27T09:22:30.019725+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: audit 2021-01-27T09:22:30.020366+0000 mon.b (mon.2) 3 : audit [INF] from='client.? 172.21.15.47:0/3193063672' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: audit 2021-01-27T09:22:30.030238+0000 mon.a (mon.0) 390 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]': finished 2021-01-27T09:22:30.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: cluster 2021-01-27T09:22:30.030560+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T09:22:30.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: audit 2021-01-27T09:22:30.030802+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:30.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[13570]: cluster 2021-01-27T09:22:30.169508+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:30.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: cluster 2021-01-27T09:22:29.339918+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T09:22:30.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: audit 2021-01-27T09:22:30.019725+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: audit 2021-01-27T09:22:30.020366+0000 mon.b (mon.2) 3 : audit [INF] from='client.? 172.21.15.47:0/3193063672' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: audit 2021-01-27T09:22:30.030238+0000 mon.a (mon.0) 390 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]': finished 2021-01-27T09:22:30.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: cluster 2021-01-27T09:22:30.030560+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T09:22:30.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: audit 2021-01-27T09:22:30.030802+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:30.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:30 smithi103 bash[9772]: cluster 2021-01-27T09:22:30.169508+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:30.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: cluster 2021-01-27T09:22:29.339918+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T09:22:30.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: audit 2021-01-27T09:22:30.019725+0000 mon.a (mon.0) 389 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: audit 2021-01-27T09:22:30.020366+0000 mon.b (mon.2) 3 : audit [INF] from='client.? 172.21.15.47:0/3193063672' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]: dispatch 2021-01-27T09:22:30.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: audit 2021-01-27T09:22:30.030238+0000 mon.a (mon.0) 390 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "236c2a5a-cd0f-4473-9374-76acb70278a9"}]': finished 2021-01-27T09:22:30.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: cluster 2021-01-27T09:22:30.030560+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T09:22:30.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: audit 2021-01-27T09:22:30.030802+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:30.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:30 smithi047 bash[9721]: cluster 2021-01-27T09:22:30.169508+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:31.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:31 smithi103 bash[9772]: audit 2021-01-27T09:22:30.653990+0000 mon.b (mon.2) 4 : audit [DBG] from='client.? 172.21.15.47:0/1494731587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:31.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:31 smithi103 bash[13570]: audit 2021-01-27T09:22:30.653990+0000 mon.b (mon.2) 4 : audit [DBG] from='client.? 172.21.15.47:0/1494731587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:31.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:31 smithi047 bash[9721]: audit 2021-01-27T09:22:30.653990+0000 mon.b (mon.2) 4 : audit [DBG] from='client.? 172.21.15.47:0/1494731587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:32.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:32 smithi103 bash[9772]: cluster 2021-01-27T09:22:32.170024+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:32.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:32 smithi103 bash[13570]: cluster 2021-01-27T09:22:32.170024+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:32.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:32 smithi047 bash[9721]: cluster 2021-01-27T09:22:32.170024+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:34.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:34 smithi047 bash[9721]: audit 2021-01-27T09:22:34.008106+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:34.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:34 smithi047 bash[9721]: cluster 2021-01-27T09:22:34.170565+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:34.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:34 smithi103 bash[9772]: audit 2021-01-27T09:22:34.008106+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:34.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:34 smithi103 bash[9772]: cluster 2021-01-27T09:22:34.170565+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:34.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:34 smithi103 bash[13570]: audit 2021-01-27T09:22:34.008106+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:34.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:34 smithi103 bash[13570]: cluster 2021-01-27T09:22:34.170565+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:36.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:36 smithi047 bash[9721]: cluster 2021-01-27T09:22:36.171175+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:36.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:36 smithi103 bash[9772]: cluster 2021-01-27T09:22:36.171175+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:36.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:36 smithi103 bash[13570]: cluster 2021-01-27T09:22:36.171175+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:38.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:38 smithi047 bash[9721]: cluster 2021-01-27T09:22:38.171696+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:38.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:38 smithi103 bash[9772]: cluster 2021-01-27T09:22:38.171696+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:38.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:38 smithi103 bash[13570]: cluster 2021-01-27T09:22:38.171696+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:39.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:39 smithi047 bash[9721]: audit 2021-01-27T09:22:38.660444+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T09:22:39.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:39 smithi047 bash[9721]: audit 2021-01-27T09:22:38.662324+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:39.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:39 smithi047 bash[9721]: cephadm 2021-01-27T09:22:38.663809+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.4 on smithi047 2021-01-27T09:22:39.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:39 smithi047 bash[9721]: audit 2021-01-27T09:22:38.664723+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T09:22:39.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[9772]: audit 2021-01-27T09:22:38.660444+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T09:22:39.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[9772]: audit 2021-01-27T09:22:38.662324+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:39.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[9772]: cephadm 2021-01-27T09:22:38.663809+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.4 on smithi047 2021-01-27T09:22:39.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[9772]: audit 2021-01-27T09:22:38.664723+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T09:22:39.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[13570]: audit 2021-01-27T09:22:38.660444+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T09:22:39.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[13570]: audit 2021-01-27T09:22:38.662324+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:39.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[13570]: cephadm 2021-01-27T09:22:38.663809+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.4 on smithi047 2021-01-27T09:22:39.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:39 smithi103 bash[13570]: audit 2021-01-27T09:22:38.664723+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T09:22:40.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:40 smithi047 bash[9721]: cluster 2021-01-27T09:22:40.172264+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:40.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:40 smithi103 bash[9772]: cluster 2021-01-27T09:22:40.172264+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:40.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:40 smithi103 bash[13570]: cluster 2021-01-27T09:22:40.172264+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:41.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.444+0000 7fb8b5ffb700 1 -- 172.21.15.47:0/4136836575 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8c0100620 con 0x7fb8ac05bc30 2021-01-27T09:22:41.443 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 4 on host 'smithi047' 2021-01-27T09:22:41.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 msgr2=0x7fb8ac05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:41.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 0x7fb8ac05e0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8c006a820 tx=0x7fb8b000b040).stop 2021-01-27T09:22:41.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 msgr2=0x7fb8c0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:41.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb8b800ee40 tx=0x7fb8b800b040).stop 2021-01-27T09:22:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 shutdown_connections 2021-01-27T09:22:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb8ac05bc30 0x7fb8ac05e0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8c00f7490 0x7fb8c0069560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8c00f58a0 0x7fb8c006aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 --2- 172.21.15.47:0/4136836575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8c00f6b40 0x7fb8c0068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 >> 172.21.15.47:0/4136836575 conn(0x7fb8c00f10a0 msgr2=0x7fb8c00f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:22:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 shutdown_connections 2021-01-27T09:22:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:41.448+0000 7fb8c64a0700 1 -- 172.21.15.47:0/4136836575 wait complete. 2021-01-27T09:22:41.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:41 smithi047 bash[9721]: audit 2021-01-27T09:22:41.434238+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:41.488 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:41 smithi047 bash[9721]: audit 2021-01-27T09:22:41.440046+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:41.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:41 smithi103 bash[9772]: audit 2021-01-27T09:22:41.434238+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:41.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:41 smithi103 bash[9772]: audit 2021-01-27T09:22:41.440046+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:41.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:41 smithi103 bash[13570]: audit 2021-01-27T09:22:41.434238+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:41.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:41 smithi103 bash[13570]: audit 2021-01-27T09:22:41.440046+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:42.773 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:42 smithi047 bash[9721]: cephadm 2021-01-27T09:22:41.433100+0000 mgr.y (mgr.14138) 163 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:22:42.773 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:42 smithi047 bash[9721]: cluster 2021-01-27T09:22:42.172832+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:42.774 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:42 smithi047 bash[9721]: audit 2021-01-27T09:22:42.386342+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:42.774 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:42 smithi047 bash[9721]: audit 2021-01-27T09:22:42.388269+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:42.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[9772]: cephadm 2021-01-27T09:22:41.433100+0000 mgr.y (mgr.14138) 163 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:22:42.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[9772]: cluster 2021-01-27T09:22:42.172832+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:42.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[9772]: audit 2021-01-27T09:22:42.386342+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:42.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[9772]: audit 2021-01-27T09:22:42.388269+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:42.891 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[13570]: cephadm 2021-01-27T09:22:41.433100+0000 mgr.y (mgr.14138) 163 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:22:42.891 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[13570]: cluster 2021-01-27T09:22:42.172832+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:42.891 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[13570]: audit 2021-01-27T09:22:42.386342+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:42.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:42 smithi103 bash[13570]: audit 2021-01-27T09:22:42.388269+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:43.160 DEBUG:teuthology.orchestra.run.smithi047:osd.4> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.4.service 2021-01-27T09:22:43.163 INFO:tasks.cephadm:Deploying osd.5 on smithi047 with /dev/vg_nvme/lv_3... 2021-01-27T09:22:43.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T09:22:43.246 INFO:journalctl@ceph.osd.4.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:22:44.600 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[9721]: cluster 2021-01-27T09:22:44.173346+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:44.600 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T09:22:44.600 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-01-27T09:22:44.601 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-01-27T09:22:44.601 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-01-27T09:22:44.601 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T09:22:44.601 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T09:22:44.601 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:44 smithi047 bash[12226]: --> ceph-volume lvm activate successful for osd ID: 4 2021-01-27T09:22:44.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:44 smithi103 bash[13570]: cluster 2021-01-27T09:22:44.173346+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:44.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:44 smithi103 bash[9772]: cluster 2021-01-27T09:22:44.173346+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:46.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:46 smithi047 bash[9721]: cluster 2021-01-27T09:22:46.173903+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:46.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:46 smithi103 bash[9772]: cluster 2021-01-27T09:22:46.173903+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:46.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:46 smithi103 bash[13570]: cluster 2021-01-27T09:22:46.173903+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:48.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[9721]: cluster 2021-01-27T09:22:48.174447+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:48.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:48 smithi103 bash[9772]: cluster 2021-01-27T09:22:48.174447+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:48.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:48 smithi103 bash[13570]: cluster 2021-01-27T09:22:48.174447+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:48.758 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 msgr2=0x563102f29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:22:48.758 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 msgr2=0x563102f29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:22:48.759 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_read_frame_preamble_main r=0 2021-01-27T09:22:48.759 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_MESSAGE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).throttle_message 2021-01-27T09:22:48.760 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_BYTES pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).throttle_bytes 2021-01-27T09:22:48.760 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).throttle_dispatch_queue 2021-01-27T09:22:48.760 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).read_frame_segment seg_idx=0 2021-01-27T09:22:48.761 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).read_frame_segment seg_idx=1 2021-01-27T09:22:48.761 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 msgr2=0x563102f29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:22:48.762 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_read_frame_segment r=0 2021-01-27T09:22:48.762 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 msgr2=0x563102f29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:22:48.763 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_read_frame_epilogue_main r=0 2021-01-27T09:22:48.763 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 10 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_read_frame_dispatch tag=17 2021-01-27T09:22:48.763 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_message 2021-01-27T09:22:48.764 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 5 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T09:22:48.764 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 5 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).handle_message received message m=0x563102f3e4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:22:48.764 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 queue 0x563102f3e4e0 prio 196 2021-01-27T09:22:48.765 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 --2- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 0x563102f29400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x563102f39e60 tx=0x563102f6ed80).read_frame 2021-01-27T09:22:48.765 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175db61700 20 -- 172.21.15.47:0/145577791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563102fbcc00 msgr2=0x563102f29400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:22:48.765 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175cb5f700 1 -- 172.21.15.47:0/145577791 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563102f3e4e0 con 0x563102fbcc00 2021-01-27T09:22:48.765 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175cb5f700 10 -- 172.21.15.47:0/145577791 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:22:48.766 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:48 smithi047 bash[12576]: debug 2021-01-27T09:22:48.560+0000 7f175cb5f700 20 -- 172.21.15.47:0/145577791 done calling dispatch on 0x563102f3e4e0 2021-01-27T09:22:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T09:22:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T09:22:49.336 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2021-01-27T09:22:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2021-01-27T09:22:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0143783 s, 729 MB/s 2021-01-27T09:22:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2021-01-27T09:22:49.402 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:49 smithi047 bash[12576]: debug 2021-01-27T09:22:49.116+0000 7f17645ea200 -1 Falling back to public interface 2021-01-27T09:22:50.494 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:50 smithi047 bash[9721]: cluster 2021-01-27T09:22:50.175007+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:50.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2021-01-27T09:22:50.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:50 smithi103 bash[9772]: cluster 2021-01-27T09:22:50.175007+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:50.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:50 smithi103 bash[13570]: cluster 2021-01-27T09:22:50.175007+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:51.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:51 smithi047 bash[9721]: audit 2021-01-27T09:22:51.160147+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:51.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:51 smithi103 bash[13570]: audit 2021-01-27T09:22:51.160147+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:51.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:51 smithi103 bash[9772]: audit 2021-01-27T09:22:51.160147+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:22:52.529 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[12576]: debug 2021-01-27T09:22:52.136+0000 7f17645ea200 -1 osd.4 0 log_to_monitors {default=true} 2021-01-27T09:22:52.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: audit 2021-01-27T09:22:51.534238+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: audit 2021-01-27T09:22:51.543600+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: cephadm 2021-01-27T09:22:51.545103+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: audit 2021-01-27T09:22:51.554660+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: cephadm 2021-01-27T09:22:51.555753+0000 mgr.y (mgr.14138) 170 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: audit 2021-01-27T09:22:52.146061+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: audit 2021-01-27T09:22:52.146984+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:52 smithi047 bash[9721]: cluster 2021-01-27T09:22:52.175542+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:52.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: audit 2021-01-27T09:22:51.534238+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: audit 2021-01-27T09:22:51.543600+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: cephadm 2021-01-27T09:22:51.545103+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: audit 2021-01-27T09:22:51.554660+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: cephadm 2021-01-27T09:22:51.555753+0000 mgr.y (mgr.14138) 170 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: audit 2021-01-27T09:22:52.146061+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: audit 2021-01-27T09:22:52.146984+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[9772]: cluster 2021-01-27T09:22:52.175542+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:52.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: audit 2021-01-27T09:22:51.534238+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: audit 2021-01-27T09:22:51.543600+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: cephadm 2021-01-27T09:22:51.545103+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: audit 2021-01-27T09:22:51.554660+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:22:52.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: cephadm 2021-01-27T09:22:51.555753+0000 mgr.y (mgr.14138) 170 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:22:52.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: audit 2021-01-27T09:22:52.146061+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: audit 2021-01-27T09:22:52.146984+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T09:22:52.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:52 smithi103 bash[13570]: cluster 2021-01-27T09:22:52.175542+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 -- 172.21.15.47:0/1890767137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 msgr2=0x7fb7700f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 --2- 172.21.15.47:0/1890767137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f8540 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb76c009dc0 tx=0x7fb76c004d10).stop 2021-01-27T09:22:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 -- 172.21.15.47:0/1890767137 shutdown_connections 2021-01-27T09:22:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 --2- 172.21.15.47:0/1890767137 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700fb4a0 0x7fb7700fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 --2- 172.21.15.47:0/1890767137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f8540 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 --2- 172.21.15.47:0/1890767137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700f8a30 0x7fb7700fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.884+0000 7fb776d96700 1 -- 172.21.15.47:0/1890767137 >> 172.21.15.47:0/1890767137 conn(0x7fb7700effa0 msgr2=0x7fb7700f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:22:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- 172.21.15.47:0/1890767137 shutdown_connections 2021-01-27T09:22:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- 172.21.15.47:0/1890767137 wait complete. 2021-01-27T09:22:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 Processor -- start 2021-01-27T09:22:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- start start 2021-01-27T09:22:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 0x7fb7700f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700fb4a0 0x7fb7700f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700f5180 con 0x7fb77005f610 2021-01-27T09:22:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700f52f0 con 0x7fb7700fb4a0 2021-01-27T09:22:53.888 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77010f9d0 con 0x7fb7700f8a30 2021-01-27T09:22:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37602/0 (socket says 172.21.15.47:37602) 2021-01-27T09:22:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 -- 172.21.15.47:0/2810555467 learned_addr learned my addr 172.21.15.47:0/2810555467 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:22:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776595700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700fb4a0 0x7fb7700f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775593700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 0x7fb7700f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 -- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 msgr2=0x7fb7700f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 0x7fb7700f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 -- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700fb4a0 msgr2=0x7fb7700f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:22:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700fb4a0 0x7fb7700f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 -- 172.21.15.47:0/2810555467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77010fb90 con 0x7fb77005f610 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775593700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 0x7fb7700f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb775d94700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb76c004b70 tx=0x7fb76c004d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00e030 con 0x7fb77005f610 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb76c0044e0 con 0x7fb77005f610 2021-01-27T09:22:53.891 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77010fde0 con 0x7fb77005f610 2021-01-27T09:22:53.892 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c018070 con 0x7fb77005f610 2021-01-27T09:22:53.892 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.888+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb770110190 con 0x7fb77005f610 2021-01-27T09:22:53.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[13570]: audit 2021-01-27T09:22:52.561762+0000 mon.a (mon.0) 406 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T09:22:53.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[13570]: cluster 2021-01-27T09:22:52.561998+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T09:22:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[13570]: audit 2021-01-27T09:22:52.562306+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[13570]: audit 2021-01-27T09:22:52.564638+0000 mon.a (mon.0) 409 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[13570]: audit 2021-01-27T09:22:52.565395+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:53.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[9772]: audit 2021-01-27T09:22:52.561762+0000 mon.a (mon.0) 406 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T09:22:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[9772]: cluster 2021-01-27T09:22:52.561998+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T09:22:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[9772]: audit 2021-01-27T09:22:52.562306+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[9772]: audit 2021-01-27T09:22:52.564638+0000 mon.a (mon.0) 409 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:53 smithi103 bash[9772]: audit 2021-01-27T09:22:52.565395+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:53.896 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.892+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700f3b90 con 0x7fb77005f610 2021-01-27T09:22:53.896 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.892+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fb76c013630 con 0x7fb77005f610 2021-01-27T09:22:53.896 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.892+0000 7fb7667fc700 1 --2- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 0x7fb75c05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:22:53.896 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.892+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3022+0+0 (secure 0 0 0) 0x7fb76c076d50 con 0x7fb77005f610 2021-01-27T09:22:53.896 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.892+0000 7fb775593700 1 --2- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 0x7fb75c05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:22:53.897 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.896+0000 7fb775593700 1 --2- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 0x7fb75c05e0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb77005f3e0 tx=0x7fb760009c80).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:22:53.898 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:53.900+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb76c04a620 con 0x7fb77005f610 2021-01-27T09:22:54.044 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[12576]: debug 2021-01-27T09:22:53.572+0000 7f175ab5b700 -1 osd.4 0 waiting for initial osdmap 2021-01-27T09:22:54.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[9721]: audit 2021-01-27T09:22:52.561762+0000 mon.a (mon.0) 406 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T09:22:54.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[9721]: cluster 2021-01-27T09:22:52.561998+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T09:22:54.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[9721]: audit 2021-01-27T09:22:52.562306+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[9721]: audit 2021-01-27T09:22:52.564638+0000 mon.a (mon.0) 409 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:54.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:53 smithi047 bash[9721]: audit 2021-01-27T09:22:52.565395+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 v2:172.21.15.47:6800/4117565580' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:22:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:22:54.092+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb770100650 con 0x7fb75c05bc30 2021-01-27T09:22:54.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:53.567112+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:22:54.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: cluster 2021-01-27T09:22:53.567414+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T09:22:54.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:53.568245+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:53.576837+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:54.097160+0000 mgr.y (mgr.14138) 172 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:54.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:54.099274+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:54.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: cephadm 2021-01-27T09:22:54.102047+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:54.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:54.102576+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:54.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:54.104339+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:54.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: audit 2021-01-27T09:22:54.106432+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:54.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:54 smithi047 bash[9721]: cluster 2021-01-27T09:22:54.176100+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:54.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:53.567112+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:22:54.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: cluster 2021-01-27T09:22:53.567414+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T09:22:54.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:53.568245+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:53.576837+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:54.097160+0000 mgr.y (mgr.14138) 172 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:54.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:54.099274+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:54.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: cephadm 2021-01-27T09:22:54.102047+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:54.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:54.102576+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:54.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:54.104339+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:54.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: audit 2021-01-27T09:22:54.106432+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:54.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[9772]: cluster 2021-01-27T09:22:54.176100+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:54.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:53.567112+0000 mon.a (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:22:54.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: cluster 2021-01-27T09:22:53.567414+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T09:22:54.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:53.568245+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:53.576837+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:54.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:54.097160+0000 mgr.y (mgr.14138) 172 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:22:54.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:54.099274+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:22:54.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: cephadm 2021-01-27T09:22:54.102047+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:22:54.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:54.102576+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:22:54.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:54.104339+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:22:54.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: audit 2021-01-27T09:22:54.106432+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:22:54.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:54 smithi103 bash[13570]: cluster 2021-01-27T09:22:54.176100+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T09:22:55.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: cluster 2021-01-27T09:22:53.131818+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:55.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: cluster 2021-01-27T09:22:53.132039+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:55.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: cluster 2021-01-27T09:22:54.578912+0000 mon.a (mon.0) 418 : cluster [INF] osd.4 v2:172.21.15.47:6800/4117565580 boot 2021-01-27T09:22:55.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: cluster 2021-01-27T09:22:54.579085+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T09:22:55.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: audit 2021-01-27T09:22:54.580139+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:55.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:55 smithi047 bash[9721]: cluster 2021-01-27T09:22:55.580920+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T09:22:55.889 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: cluster 2021-01-27T09:22:53.131818+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:55.889 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: cluster 2021-01-27T09:22:53.132039+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:55.889 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: cluster 2021-01-27T09:22:54.578912+0000 mon.a (mon.0) 418 : cluster [INF] osd.4 v2:172.21.15.47:6800/4117565580 boot 2021-01-27T09:22:55.889 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: cluster 2021-01-27T09:22:54.579085+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T09:22:55.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: audit 2021-01-27T09:22:54.580139+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:55.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[13570]: cluster 2021-01-27T09:22:55.580920+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T09:22:55.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: cluster 2021-01-27T09:22:53.131818+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:22:55.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: cluster 2021-01-27T09:22:53.132039+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:22:55.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: cluster 2021-01-27T09:22:54.578912+0000 mon.a (mon.0) 418 : cluster [INF] osd.4 v2:172.21.15.47:6800/4117565580 boot 2021-01-27T09:22:55.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: cluster 2021-01-27T09:22:54.579085+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T09:22:55.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: audit 2021-01-27T09:22:54.580139+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T09:22:55.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:55 smithi103 bash[9772]: cluster 2021-01-27T09:22:55.580920+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T09:22:56.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:56 smithi103 bash[9772]: cluster 2021-01-27T09:22:56.176698+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:56.889 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:56 smithi103 bash[13570]: cluster 2021-01-27T09:22:56.176698+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:57.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:56 smithi047 bash[9721]: cluster 2021-01-27T09:22:56.176698+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:58.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:58 smithi047 bash[9721]: cluster 2021-01-27T09:22:58.177218+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:58.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:58 smithi103 bash[9772]: cluster 2021-01-27T09:22:58.177218+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:58.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:58 smithi103 bash[13570]: cluster 2021-01-27T09:22:58.177218+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:22:59.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.324825+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:22:59.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.325820+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.325994+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.47:0/2589524406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.328063+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:22:59.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.333961+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]': finished 2021-01-27T09:22:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: cluster 2021-01-27T09:22:58.334222+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T09:22:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:58.334477+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:22:59.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:22:59 smithi047 bash[9721]: audit 2021-01-27T09:22:59.004439+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.47:0/830601577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:59.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.324825+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:22:59.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.325820+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.325994+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.47:0/2589524406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.328063+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:22:59.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.333961+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]': finished 2021-01-27T09:22:59.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: cluster 2021-01-27T09:22:58.334222+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T09:22:59.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:58.334477+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:22:59.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[9772]: audit 2021-01-27T09:22:59.004439+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.47:0/830601577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:22:59.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.324825+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:22:59.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.325820+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.325994+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.47:0/2589524406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]: dispatch 2021-01-27T09:22:59.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.328063+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:22:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.333961+0000 mon.a (mon.0) 425 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85931400-41a6-4838-aec6-8e7c174de20b"}]': finished 2021-01-27T09:22:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: cluster 2021-01-27T09:22:58.334222+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T09:22:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:58.334477+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:22:59.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:22:59 smithi103 bash[13570]: audit 2021-01-27T09:22:59.004439+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.47:0/830601577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:00.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:00 smithi047 bash[9721]: cluster 2021-01-27T09:23:00.177807+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:00.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:00 smithi103 bash[9772]: cluster 2021-01-27T09:23:00.177807+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:00.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:00 smithi103 bash[13570]: cluster 2021-01-27T09:23:00.177807+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:02.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:02 smithi047 bash[9721]: cluster 2021-01-27T09:23:02.178371+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:02.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:02 smithi103 bash[13570]: cluster 2021-01-27T09:23:02.178371+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:02.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:02 smithi103 bash[9772]: cluster 2021-01-27T09:23:02.178371+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:03.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:03 smithi047 bash[9721]: audit 2021-01-27T09:23:02.294243+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:03.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:03 smithi103 bash[9772]: audit 2021-01-27T09:23:02.294243+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:03.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:03 smithi103 bash[13570]: audit 2021-01-27T09:23:02.294243+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:04.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:04 smithi047 bash[9721]: cluster 2021-01-27T09:23:04.178984+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:04.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:04 smithi103 bash[9772]: cluster 2021-01-27T09:23:04.178984+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:04.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:04 smithi103 bash[13570]: cluster 2021-01-27T09:23:04.178984+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:06.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:06 smithi047 bash[9721]: cluster 2021-01-27T09:23:06.179558+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:06.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:06 smithi103 bash[13570]: cluster 2021-01-27T09:23:06.179558+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:06.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:06 smithi103 bash[9772]: cluster 2021-01-27T09:23:06.179558+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:07.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:07 smithi047 bash[9721]: audit 2021-01-27T09:23:06.798482+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T09:23:07.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:07 smithi047 bash[9721]: audit 2021-01-27T09:23:06.800420+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:07.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:07 smithi047 bash[9721]: cephadm 2021-01-27T09:23:06.801770+0000 mgr.y (mgr.14138) 181 : cephadm [INF] Deploying daemon osd.5 on smithi047 2021-01-27T09:23:07.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:07 smithi047 bash[9721]: audit 2021-01-27T09:23:06.802699+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T09:23:07.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[9772]: audit 2021-01-27T09:23:06.798482+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T09:23:07.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[9772]: audit 2021-01-27T09:23:06.800420+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:07.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[9772]: cephadm 2021-01-27T09:23:06.801770+0000 mgr.y (mgr.14138) 181 : cephadm [INF] Deploying daemon osd.5 on smithi047 2021-01-27T09:23:07.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[9772]: audit 2021-01-27T09:23:06.802699+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T09:23:07.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[13570]: audit 2021-01-27T09:23:06.798482+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T09:23:07.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[13570]: audit 2021-01-27T09:23:06.800420+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:07.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[13570]: cephadm 2021-01-27T09:23:06.801770+0000 mgr.y (mgr.14138) 181 : cephadm [INF] Deploying daemon osd.5 on smithi047 2021-01-27T09:23:07.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:07 smithi103 bash[13570]: audit 2021-01-27T09:23:06.802699+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T09:23:08.438 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:08 smithi047 bash[9721]: cluster 2021-01-27T09:23:08.180106+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:08.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:08 smithi103 bash[9772]: cluster 2021-01-27T09:23:08.180106+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:08.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:08 smithi103 bash[13570]: cluster 2021-01-27T09:23:08.180106+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:09.658 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.660+0000 7fb7667fc700 1 -- 172.21.15.47:0/2810555467 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb770100650 con 0x7fb75c05bc30 2021-01-27T09:23:09.658 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 5 on host 'smithi047' 2021-01-27T09:23:09.660 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 msgr2=0x7fb75c05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:09.661 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 0x7fb75c05e0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb77005f3e0 tx=0x7fb760009c80).stop 2021-01-27T09:23:09.661 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 msgr2=0x7fb7700f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:09.661 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb76c004b70 tx=0x7fb76c004d10).stop 2021-01-27T09:23:09.662 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 shutdown_connections 2021-01-27T09:23:09.662 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb75c05bc30 0x7fb75c05e0f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:09.662 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7700fb4a0 0x7fb7700f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb77005f610 0x7fb7700f5fc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 --2- 172.21.15.47:0/2810555467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7700f8a30 0x7fb7700f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 >> 172.21.15.47:0/2810555467 conn(0x7fb7700effa0 msgr2=0x7fb7700f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:23:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 shutdown_connections 2021-01-27T09:23:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:09.664+0000 7fb776d96700 1 -- 172.21.15.47:0/2810555467 wait complete. 2021-01-27T09:23:09.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:09 smithi047 bash[9721]: audit 2021-01-27T09:23:09.656726+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:09.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:09 smithi047 bash[9721]: audit 2021-01-27T09:23:09.661542+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:10.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:09 smithi103 bash[9772]: audit 2021-01-27T09:23:09.656726+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:10.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:09 smithi103 bash[9772]: audit 2021-01-27T09:23:09.661542+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:10.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:09 smithi103 bash[13570]: audit 2021-01-27T09:23:09.656726+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:10.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:09 smithi103 bash[13570]: audit 2021-01-27T09:23:09.661542+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:11.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:10 smithi047 bash[9721]: cluster 2021-01-27T09:23:10.180631+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:11.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:10 smithi047 bash[9721]: audit 2021-01-27T09:23:10.676453+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:11.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:10 smithi047 bash[9721]: audit 2021-01-27T09:23:10.677844+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:11.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[9772]: cluster 2021-01-27T09:23:10.180631+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:11.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[9772]: audit 2021-01-27T09:23:10.676453+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:11.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[9772]: audit 2021-01-27T09:23:10.677844+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:11.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[13570]: cluster 2021-01-27T09:23:10.180631+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:11.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[13570]: audit 2021-01-27T09:23:10.676453+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:11.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:10 smithi103 bash[13570]: audit 2021-01-27T09:23:10.677844+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:11.266 DEBUG:teuthology.orchestra.run.smithi047:osd.5> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.5.service 2021-01-27T09:23:11.268 INFO:tasks.cephadm:Deploying osd.6 on smithi047 with /dev/vg_nvme/lv_2... 2021-01-27T09:23:11.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T09:23:11.402 INFO:journalctl@ceph.osd.5.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:23:12.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[9721]: cluster 2021-01-27T09:23:12.181177+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:12.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:12 smithi103 bash[9772]: cluster 2021-01-27T09:23:12.181177+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:12.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:12 smithi103 bash[13570]: cluster 2021-01-27T09:23:12.181177+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:13.057 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T09:23:13.058 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-01-27T09:23:13.058 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-01-27T09:23:13.058 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-01-27T09:23:13.059 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T09:23:13.059 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T09:23:13.060 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:12 smithi047 bash[14703]: --> ceph-volume lvm activate successful for osd ID: 5 2021-01-27T09:23:14.323 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:14 smithi047 bash[9721]: cluster 2021-01-27T09:23:14.181740+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:14.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:14 smithi103 bash[9772]: cluster 2021-01-27T09:23:14.181740+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:14.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:14 smithi103 bash[13570]: cluster 2021-01-27T09:23:14.181740+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:16.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:16 smithi047 bash[9721]: cluster 2021-01-27T09:23:16.182349+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:16.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:16 smithi103 bash[13570]: cluster 2021-01-27T09:23:16.182349+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:16.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:16 smithi103 bash[9772]: cluster 2021-01-27T09:23:16.182349+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:17.294 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 msgr2=0x561c5e297e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:23:17.295 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 msgr2=0x561c5e297e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:23:17.295 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_read_frame_preamble_main r=0 2021-01-27T09:23:17.295 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_MESSAGE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).throttle_message 2021-01-27T09:23:17.296 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_BYTES pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).throttle_bytes 2021-01-27T09:23:17.296 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).throttle_dispatch_queue 2021-01-27T09:23:17.296 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).read_frame_segment seg_idx=0 2021-01-27T09:23:17.296 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).read_frame_segment seg_idx=1 2021-01-27T09:23:17.296 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 msgr2=0x561c5e297e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:23:17.297 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_read_frame_segment r=0 2021-01-27T09:23:17.297 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 msgr2=0x561c5e297e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:23:17.297 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_read_frame_epilogue_main r=0 2021-01-27T09:23:17.297 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 10 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_read_frame_dispatch tag=17 2021-01-27T09:23:17.297 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_message 2021-01-27T09:23:17.298 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 5 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T09:23:17.298 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 5 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).handle_message received message m=0x561c5e2ac4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:23:17.298 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 queue 0x561c5e2ac4e0 prio 196 2021-01-27T09:23:17.298 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 --2- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 0x561c5e297e00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x561c5e2a7e60 tx=0x561c5e2dcd80).read_frame 2021-01-27T09:23:17.299 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49c35700 20 -- 172.21.15.47:0/1146188378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c5e32b000 msgr2=0x561c5e297e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:23:17.299 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49434700 1 -- 172.21.15.47:0/1146188378 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561c5e2ac4e0 con 0x561c5e32b000 2021-01-27T09:23:17.299 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49434700 10 -- 172.21.15.47:0/1146188378 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:23:17.299 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.072+0000 7f5d49434700 20 -- 172.21.15.47:0/1146188378 done calling dispatch on 0x561c5e2ac4e0 2021-01-27T09:23:18.044 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:17 smithi047 bash[15060]: debug 2021-01-27T09:23:17.600+0000 7f5d50ebf200 -1 Falling back to public interface 2021-01-27T09:23:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:18 smithi047 bash[9721]: cluster 2021-01-27T09:23:18.182924+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:18.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:18 smithi103 bash[13570]: cluster 2021-01-27T09:23:18.182924+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:18.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:18 smithi103 bash[9772]: cluster 2021-01-27T09:23:18.182924+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:18.836 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T09:23:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T09:23:18.837 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2021-01-27T09:23:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2021-01-27T09:23:18.837 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133124 s, 788 MB/s 2021-01-27T09:23:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2021-01-27T09:23:19.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2021-01-27T09:23:20.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:20 smithi047 bash[9721]: cluster 2021-01-27T09:23:20.183549+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:20.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:20 smithi103 bash[9772]: cluster 2021-01-27T09:23:20.183549+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:20.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:20 smithi103 bash[13570]: cluster 2021-01-27T09:23:20.183549+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:21.044 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:20 smithi047 bash[15060]: debug 2021-01-27T09:23:20.592+0000 7f5d50ebf200 -1 osd.5 0 log_to_monitors {default=true} 2021-01-27T09:23:21.503 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:21 smithi047 bash[9721]: audit 2021-01-27T09:23:20.599459+0000 mon.c (mon.1) 11 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.504 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:21 smithi047 bash[9721]: audit 2021-01-27T09:23:20.600326+0000 mon.a (mon.0) 436 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.504 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:21 smithi047 bash[9721]: audit 2021-01-27T09:23:21.136244+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:21.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[9772]: audit 2021-01-27T09:23:20.599459+0000 mon.c (mon.1) 11 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[9772]: audit 2021-01-27T09:23:20.600326+0000 mon.a (mon.0) 436 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[9772]: audit 2021-01-27T09:23:21.136244+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:21.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[13570]: audit 2021-01-27T09:23:20.599459+0000 mon.c (mon.1) 11 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[13570]: audit 2021-01-27T09:23:20.600326+0000 mon.a (mon.0) 436 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T09:23:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:21 smithi103 bash[13570]: audit 2021-01-27T09:23:21.136244+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:22.544 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[15060]: debug 2021-01-27T09:23:22.284+0000 7f5d47430700 -1 osd.5 0 waiting for initial osdmap 2021-01-27T09:23:22.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.271109+0000 mon.a (mon.0) 438 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T09:23:22.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: cluster 2021-01-27T09:23:21.271290+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T09:23:22.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.271491+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:22.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.272707+0000 mon.c (mon.1) 12 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.273227+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.540018+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: cephadm 2021-01-27T09:23:21.541449+0000 mgr.y (mgr.14138) 189 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:23:22.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.971011+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: cephadm 2021-01-27T09:23:21.973014+0000 mgr.y (mgr.14138) 190 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: audit 2021-01-27T09:23:21.981980+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: cephadm 2021-01-27T09:23:21.983322+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:22 smithi047 bash[9721]: cluster 2021-01-27T09:23:22.184181+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.271109+0000 mon.a (mon.0) 438 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T09:23:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: cluster 2021-01-27T09:23:21.271290+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T09:23:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.271491+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.272707+0000 mon.c (mon.1) 12 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.273227+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.540018+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: cephadm 2021-01-27T09:23:21.541449+0000 mgr.y (mgr.14138) 189 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:23:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.971011+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: cephadm 2021-01-27T09:23:21.973014+0000 mgr.y (mgr.14138) 190 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: audit 2021-01-27T09:23:21.981980+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: cephadm 2021-01-27T09:23:21.983322+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[9772]: cluster 2021-01-27T09:23:22.184181+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:22.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.271109+0000 mon.a (mon.0) 438 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T09:23:22.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: cluster 2021-01-27T09:23:21.271290+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T09:23:22.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.271491+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:22.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.272707+0000 mon.c (mon.1) 12 : audit [INF] from='osd.5 v2:172.21.15.47:6804/2359739468' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.273227+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:22.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.540018+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: cephadm 2021-01-27T09:23:21.541449+0000 mgr.y (mgr.14138) 189 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:23:22.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.971011+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: cephadm 2021-01-27T09:23:21.973014+0000 mgr.y (mgr.14138) 190 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: audit 2021-01-27T09:23:21.981980+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:22.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: cephadm 2021-01-27T09:23:21.983322+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:22.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:22 smithi103 bash[13570]: cluster 2021-01-27T09:23:22.184181+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T09:23:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- 172.21.15.47:0/153549087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 msgr2=0x7f3dfc0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:23.470 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- 172.21.15.47:0/153549087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc0ffb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3df4009dc0 tx=0x7f3df4004d10).stop 2021-01-27T09:23:23.470 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- 172.21.15.47:0/153549087 shutdown_connections 2021-01-27T09:23:23.470 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- 172.21.15.47:0/153549087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc0ffb20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:23.470 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- 172.21.15.47:0/153549087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc05f650 0x7f3dfc0fa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:23.471 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- 172.21.15.47:0/153549087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc0fadf0 0x7f3dfc0fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:23.471 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- 172.21.15.47:0/153549087 >> 172.21.15.47:0/153549087 conn(0x7f3dfc0effa0 msgr2=0x7f3dfc0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:23:23.471 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- 172.21.15.47:0/153549087 shutdown_connections 2021-01-27T09:23:23.471 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- 172.21.15.47:0/153549087 wait complete. 2021-01-27T09:23:23.473 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 Processor -- start 2021-01-27T09:23:23.473 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- start start 2021-01-27T09:23:23.473 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc05f650 0x7f3dfc107860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:23.474 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc0fadf0 0x7f3dfc107d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:23.474 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:23.474 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc109170 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.474 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1092e0 con 0x7f3dfc05f650 2021-01-27T09:23:23.474 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3e00aff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1094a0 con 0x7f3dfc0fadf0 2021-01-27T09:23:23.475 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3dfbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:23.475 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc05f650 0x7f3dfc107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:23.475 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3dfbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37724/0 (socket says 172.21.15.47:37724) 2021-01-27T09:23:23.475 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3dfbfff700 1 -- 172.21.15.47:0/3435507546 learned_addr learned my addr 172.21.15.47:0/3435507546 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.472+0000 7f3dfaffd700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc0fadf0 0x7f3dfc107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 -- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc0fadf0 msgr2=0x7f3dfc107d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc0fadf0 0x7f3dfc107d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 -- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc05f650 msgr2=0x7f3dfc107860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:23.476 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc05f650 0x7f3dfc107860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 -- 172.21.15.47:0/3435507546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc109660 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3dfbfff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3df4007680 tx=0x7f3df4004d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400e030 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3df4004500 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.477 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc1098b0 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4018070 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc110050 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.478 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc0f3b90 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.476+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f3df4004020 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.480+0000 7f3df3fff700 1 --2- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 0x7f3de805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:23.479 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.480+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3454+0+0 (secure 0 0 0) 0x7f3df4076d00 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.480 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.480+0000 7f3dfb7fe700 1 --2- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 0x7f3de805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:23.480 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.480+0000 7f3dfb7fe700 1 --2- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 0x7f3de805e0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3dec004c40 tx=0x7f3dec00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:23:23.480 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.484+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f3df407a030 con 0x7f3dfc0fd6d0 2021-01-27T09:23:23.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:23 smithi047 bash[9721]: audit 2021-01-27T09:23:22.275385+0000 mon.a (mon.0) 445 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:23.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:23 smithi047 bash[9721]: cluster 2021-01-27T09:23:22.275655+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T09:23:23.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:23 smithi047 bash[9721]: audit 2021-01-27T09:23:22.276565+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:23 smithi047 bash[9721]: audit 2021-01-27T09:23:22.287115+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[9772]: audit 2021-01-27T09:23:22.275385+0000 mon.a (mon.0) 445 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:23.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[9772]: cluster 2021-01-27T09:23:22.275655+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T09:23:23.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[9772]: audit 2021-01-27T09:23:22.276565+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[9772]: audit 2021-01-27T09:23:22.287115+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[13570]: audit 2021-01-27T09:23:22.275385+0000 mon.a (mon.0) 445 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:23.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[13570]: cluster 2021-01-27T09:23:22.275655+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T09:23:23.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[13570]: audit 2021-01-27T09:23:22.276565+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:23 smithi103 bash[13570]: audit 2021-01-27T09:23:22.287115+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:23.669 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:23.672+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dfc102750 con 0x7f3de805bc30 2021-01-27T09:23:24.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cluster 2021-01-27T09:23:21.574855+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:24.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cluster 2021-01-27T09:23:21.575022+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:24.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cluster 2021-01-27T09:23:23.278661+0000 mon.a (mon.0) 449 : cluster [INF] osd.5 v2:172.21.15.47:6804/2359739468 boot 2021-01-27T09:23:24.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cluster 2021-01-27T09:23:23.278735+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T09:23:24.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.279077+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:24.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.677204+0000 mgr.y (mgr.14138) 193 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:24.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.679335+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:24.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cephadm 2021-01-27T09:23:23.682059+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:24.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.682619+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:24.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.684241+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: audit 2021-01-27T09:23:23.686251+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:24.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:24 smithi047 bash[9721]: cluster 2021-01-27T09:23:24.184786+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cluster 2021-01-27T09:23:21.574855+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cluster 2021-01-27T09:23:21.575022+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cluster 2021-01-27T09:23:23.278661+0000 mon.a (mon.0) 449 : cluster [INF] osd.5 v2:172.21.15.47:6804/2359739468 boot 2021-01-27T09:23:24.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cluster 2021-01-27T09:23:23.278735+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T09:23:24.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.279077+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:24.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.677204+0000 mgr.y (mgr.14138) 193 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:24.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.679335+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:24.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cephadm 2021-01-27T09:23:23.682059+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:24.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.682619+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:24.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.684241+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:24.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: audit 2021-01-27T09:23:23.686251+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:24.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[9772]: cluster 2021-01-27T09:23:24.184786+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:24.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cluster 2021-01-27T09:23:21.574855+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:24.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cluster 2021-01-27T09:23:21.575022+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:24.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cluster 2021-01-27T09:23:23.278661+0000 mon.a (mon.0) 449 : cluster [INF] osd.5 v2:172.21.15.47:6804/2359739468 boot 2021-01-27T09:23:24.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cluster 2021-01-27T09:23:23.278735+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T09:23:24.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.279077+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T09:23:24.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.677204+0000 mgr.y (mgr.14138) 193 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:24.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.679335+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:24.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cephadm 2021-01-27T09:23:23.682059+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:24.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.682619+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:24.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.684241+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:24.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: audit 2021-01-27T09:23:23.686251+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:24.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:24 smithi103 bash[13570]: cluster 2021-01-27T09:23:24.184786+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:25.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:25 smithi047 bash[9721]: cluster 2021-01-27T09:23:24.305142+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T09:23:25.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:25 smithi103 bash[9772]: cluster 2021-01-27T09:23:24.305142+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T09:23:25.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:25 smithi103 bash[13570]: cluster 2021-01-27T09:23:24.305142+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T09:23:26.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:26 smithi103 bash[9772]: cluster 2021-01-27T09:23:26.185388+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:26.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:26 smithi103 bash[13570]: cluster 2021-01-27T09:23:26.185388+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:26.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:26 smithi047 bash[9721]: cluster 2021-01-27T09:23:26.185388+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:28.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[9772]: audit 2021-01-27T09:23:27.819772+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[9772]: audit 2021-01-27T09:23:27.820555+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.47:0/144387648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[9772]: audit 2021-01-27T09:23:27.828143+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]': finished 2021-01-27T09:23:28.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[9772]: cluster 2021-01-27T09:23:27.828340+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T09:23:28.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[9772]: audit 2021-01-27T09:23:27.828670+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:28.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[13570]: audit 2021-01-27T09:23:27.819772+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[13570]: audit 2021-01-27T09:23:27.820555+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.47:0/144387648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[13570]: audit 2021-01-27T09:23:27.828143+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]': finished 2021-01-27T09:23:28.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[13570]: cluster 2021-01-27T09:23:27.828340+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T09:23:28.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:27 smithi103 bash[13570]: audit 2021-01-27T09:23:27.828670+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:28.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:27 smithi047 bash[9721]: audit 2021-01-27T09:23:27.819772+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:27 smithi047 bash[9721]: audit 2021-01-27T09:23:27.820555+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.47:0/144387648' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]: dispatch 2021-01-27T09:23:28.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:27 smithi047 bash[9721]: audit 2021-01-27T09:23:27.828143+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f56216b-b2c6-49af-83bd-371ed5651fb0"}]': finished 2021-01-27T09:23:28.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:27 smithi047 bash[9721]: cluster 2021-01-27T09:23:27.828340+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T09:23:28.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:27 smithi047 bash[9721]: audit 2021-01-27T09:23:27.828670+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:29.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:28 smithi103 bash[9772]: cluster 2021-01-27T09:23:28.185939+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:29.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:28 smithi103 bash[9772]: audit 2021-01-27T09:23:28.487461+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.47:0/1461167790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:29.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:28 smithi103 bash[13570]: cluster 2021-01-27T09:23:28.185939+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:29.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:28 smithi103 bash[13570]: audit 2021-01-27T09:23:28.487461+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.47:0/1461167790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:29.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:28 smithi047 bash[9721]: cluster 2021-01-27T09:23:28.185939+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:29.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:28 smithi047 bash[9721]: audit 2021-01-27T09:23:28.487461+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.47:0/1461167790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:30.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:30 smithi047 bash[9721]: cluster 2021-01-27T09:23:30.186566+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:30.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:30 smithi103 bash[9772]: cluster 2021-01-27T09:23:30.186566+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:30.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:30 smithi103 bash[13570]: cluster 2021-01-27T09:23:30.186566+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:32.043 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:31 smithi047 bash[9721]: audit 2021-01-27T09:23:31.682726+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:32.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:31 smithi103 bash[9772]: audit 2021-01-27T09:23:31.682726+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:32.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:31 smithi103 bash[13570]: audit 2021-01-27T09:23:31.682726+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:33.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:32 smithi047 bash[9721]: cluster 2021-01-27T09:23:32.187175+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:33.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:32 smithi103 bash[9772]: cluster 2021-01-27T09:23:32.187175+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:33.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:32 smithi103 bash[13570]: cluster 2021-01-27T09:23:32.187175+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:34.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:34 smithi047 bash[9721]: cluster 2021-01-27T09:23:34.187787+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:34.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:34 smithi103 bash[9772]: cluster 2021-01-27T09:23:34.187787+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:34.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:34 smithi103 bash[13570]: cluster 2021-01-27T09:23:34.187787+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:36.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:36 smithi047 bash[9721]: audit 2021-01-27T09:23:36.162297+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T09:23:36.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:36 smithi047 bash[9721]: audit 2021-01-27T09:23:36.164154+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:36.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:36 smithi047 bash[9721]: cephadm 2021-01-27T09:23:36.165514+0000 mgr.y (mgr.14138) 201 : cephadm [INF] Deploying daemon osd.6 on smithi047 2021-01-27T09:23:36.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:36 smithi047 bash[9721]: audit 2021-01-27T09:23:36.166428+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T09:23:36.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:36 smithi047 bash[9721]: cluster 2021-01-27T09:23:36.188202+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:36.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[9772]: audit 2021-01-27T09:23:36.162297+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T09:23:36.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[9772]: audit 2021-01-27T09:23:36.164154+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:36.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[9772]: cephadm 2021-01-27T09:23:36.165514+0000 mgr.y (mgr.14138) 201 : cephadm [INF] Deploying daemon osd.6 on smithi047 2021-01-27T09:23:36.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[9772]: audit 2021-01-27T09:23:36.166428+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T09:23:36.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[9772]: cluster 2021-01-27T09:23:36.188202+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:36.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[13570]: audit 2021-01-27T09:23:36.162297+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T09:23:36.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[13570]: audit 2021-01-27T09:23:36.164154+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:36.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[13570]: cephadm 2021-01-27T09:23:36.165514+0000 mgr.y (mgr.14138) 201 : cephadm [INF] Deploying daemon osd.6 on smithi047 2021-01-27T09:23:36.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[13570]: audit 2021-01-27T09:23:36.166428+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T09:23:36.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:36 smithi103 bash[13570]: cluster 2021-01-27T09:23:36.188202+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:38.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:38 smithi047 bash[9721]: cluster 2021-01-27T09:23:38.188740+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:38.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:38 smithi103 bash[9772]: cluster 2021-01-27T09:23:38.188740+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:38.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:38 smithi103 bash[13570]: cluster 2021-01-27T09:23:38.188740+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:38.878 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.880+0000 7f3df3fff700 1 -- 172.21.15.47:0/3435507546 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3dfc102750 con 0x7f3de805bc30 2021-01-27T09:23:38.878 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 6 on host 'smithi047' 2021-01-27T09:23:38.881 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 msgr2=0x7f3de805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:38.881 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 0x7f3de805e0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3dec004c40 tx=0x7f3dec00b040).stop 2021-01-27T09:23:38.882 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 msgr2=0x7f3dfc108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:38.882 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3df4007680 tx=0x7f3df4004d10).stop 2021-01-27T09:23:38.882 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 shutdown_connections 2021-01-27T09:23:38.882 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> v2:172.21.15.103:6800/3303543367 conn(0x7f3de805bc30 0x7f3de805e0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:38.883 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc0fd6d0 0x7f3dfc108c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:38.883 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dfc05f650 0x7f3dfc107860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:38.883 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 --2- 172.21.15.47:0/3435507546 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dfc0fadf0 0x7f3dfc107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:38.883 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 >> 172.21.15.47:0/3435507546 conn(0x7f3dfc0effa0 msgr2=0x7f3dfc0fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:23:38.883 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 shutdown_connections 2021-01-27T09:23:38.884 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:38.884+0000 7f3e00aff700 1 -- 172.21.15.47:0/3435507546 wait complete. 2021-01-27T09:23:39.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:39 smithi047 bash[9721]: audit 2021-01-27T09:23:38.875003+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:39.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:39 smithi047 bash[9721]: audit 2021-01-27T09:23:38.880062+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:39.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:39 smithi103 bash[9772]: audit 2021-01-27T09:23:38.875003+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:39.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:39 smithi103 bash[9772]: audit 2021-01-27T09:23:38.880062+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:39.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:39 smithi103 bash[13570]: audit 2021-01-27T09:23:38.875003+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:39.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:39 smithi103 bash[13570]: audit 2021-01-27T09:23:38.880062+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:40.483 DEBUG:teuthology.orchestra.run.smithi047:osd.6> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.6.service 2021-01-27T09:23:40.486 INFO:tasks.cephadm:Deploying osd.7 on smithi047 with /dev/vg_nvme/lv_1... 2021-01-27T09:23:40.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T09:23:40.604 INFO:journalctl@ceph.osd.6.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:23:41.085 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:40 smithi047 bash[9721]: audit 2021-01-27T09:23:39.928250+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:41.085 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:40 smithi047 bash[9721]: audit 2021-01-27T09:23:39.930255+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:41.085 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:40 smithi047 bash[9721]: cluster 2021-01-27T09:23:40.189351+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:41.388 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[13570]: audit 2021-01-27T09:23:39.928250+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:41.388 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[13570]: audit 2021-01-27T09:23:39.930255+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:41.388 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[13570]: cluster 2021-01-27T09:23:40.189351+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:41.389 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[9772]: audit 2021-01-27T09:23:39.928250+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:41.389 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[9772]: audit 2021-01-27T09:23:39.930255+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:41.389 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:40 smithi103 bash[9772]: cluster 2021-01-27T09:23:40.189351+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:42.113 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T09:23:42.113 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-01-27T09:23:42.113 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-01-27T09:23:42.114 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-01-27T09:23:42.114 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T09:23:42.114 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T09:23:42.114 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:41 smithi047 bash[17220]: --> ceph-volume lvm activate successful for osd ID: 6 2021-01-27T09:23:42.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:42 smithi047 bash[9721]: cluster 2021-01-27T09:23:42.189897+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:42.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:42 smithi103 bash[9772]: cluster 2021-01-27T09:23:42.189897+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:42.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:42 smithi103 bash[13570]: cluster 2021-01-27T09:23:42.189897+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:44.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:44 smithi047 bash[9721]: audit 2021-01-27T09:23:43.319135+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:44.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:44 smithi047 bash[9721]: cluster 2021-01-27T09:23:44.190437+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:44.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:44 smithi103 bash[9772]: audit 2021-01-27T09:23:43.319135+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:44.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:44 smithi103 bash[9772]: cluster 2021-01-27T09:23:44.190437+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:44.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:44 smithi103 bash[13570]: audit 2021-01-27T09:23:43.319135+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:44.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:44 smithi103 bash[13570]: cluster 2021-01-27T09:23:44.190437+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:46.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[9721]: cluster 2021-01-27T09:23:46.190994+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:46.544 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 msgr2=0x55776eecf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:23:46.545 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 msgr2=0x55776eecf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:23:46.545 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_read_frame_preamble_main r=0 2021-01-27T09:23:46.546 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_MESSAGE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).throttle_message 2021-01-27T09:23:46.546 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_BYTES pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).throttle_bytes 2021-01-27T09:23:46.546 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).throttle_dispatch_queue 2021-01-27T09:23:46.546 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).read_frame_segment seg_idx=0 2021-01-27T09:23:46.547 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).read_frame_segment seg_idx=1 2021-01-27T09:23:46.547 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 msgr2=0x55776eecf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:23:46.547 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_read_frame_segment r=0 2021-01-27T09:23:46.547 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 msgr2=0x55776eecf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:23:46.547 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_read_frame_epilogue_main r=0 2021-01-27T09:23:46.548 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 10 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_read_frame_dispatch tag=17 2021-01-27T09:23:46.548 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_message 2021-01-27T09:23:46.548 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 5 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T09:23:46.548 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 5 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).handle_message received message m=0x55776eee44e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:23:46.549 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 queue 0x55776eee44e0 prio 196 2021-01-27T09:23:46.549 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 --2- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 0x55776eecf400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x55776eedfe60 tx=0x55776ef14d80).read_frame 2021-01-27T09:23:46.549 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21abe56700 20 -- 172.21.15.47:0/1411375250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55776ef62c00 msgr2=0x55776eecf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:23:46.549 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21aae54700 1 -- 172.21.15.47:0/1411375250 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55776eee44e0 con 0x55776ef62c00 2021-01-27T09:23:46.549 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21aae54700 10 -- 172.21.15.47:0/1411375250 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:23:46.550 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.324+0000 7f21aae54700 20 -- 172.21.15.47:0/1411375250 done calling dispatch on 0x55776eee44e0 2021-01-27T09:23:46.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:46 smithi103 bash[9772]: cluster 2021-01-27T09:23:46.190994+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:46.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:46 smithi103 bash[13570]: cluster 2021-01-27T09:23:46.190994+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:46.913 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:46 smithi047 bash[17579]: debug 2021-01-27T09:23:46.884+0000 7f21b28df200 -1 Falling back to public interface 2021-01-27T09:23:47.447 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T09:23:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T09:23:47.448 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2021-01-27T09:23:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2021-01-27T09:23:47.448 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134891 s, 777 MB/s 2021-01-27T09:23:47.449 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2021-01-27T09:23:48.380 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:48 smithi047 bash[9721]: cluster 2021-01-27T09:23:48.191543+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:48.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2021-01-27T09:23:48.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:48 smithi103 bash[9772]: cluster 2021-01-27T09:23:48.191543+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:48.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:48 smithi103 bash[13570]: cluster 2021-01-27T09:23:48.191543+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:49.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:49 smithi047 bash[9721]: audit 2021-01-27T09:23:49.445065+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:49.888 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:49 smithi103 bash[13570]: audit 2021-01-27T09:23:49.445065+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:49.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:49 smithi103 bash[9772]: audit 2021-01-27T09:23:49.445065+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:23:50.006 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:49 smithi047 bash[17579]: debug 2021-01-27T09:23:49.888+0000 7f21b28df200 -1 osd.6 0 log_to_monitors {default=true} 2021-01-27T09:23:51.043 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: audit 2021-01-27T09:23:49.829580+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: audit 2021-01-27T09:23:49.849662+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: cephadm 2021-01-27T09:23:49.851441+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:51.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: cephadm 2021-01-27T09:23:49.854873+0000 mgr.y (mgr.14138) 210 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:23:51.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: audit 2021-01-27T09:23:49.897744+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T09:23:51.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: cluster 2021-01-27T09:23:50.192126+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:51.045 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:50 smithi047 bash[9721]: audit 2021-01-27T09:23:50.267409+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: audit 2021-01-27T09:23:49.829580+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: audit 2021-01-27T09:23:49.849662+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: cephadm 2021-01-27T09:23:49.851441+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:51.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: cephadm 2021-01-27T09:23:49.854873+0000 mgr.y (mgr.14138) 210 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:23:51.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: audit 2021-01-27T09:23:49.897744+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T09:23:51.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: cluster 2021-01-27T09:23:50.192126+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:51.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[9772]: audit 2021-01-27T09:23:50.267409+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: audit 2021-01-27T09:23:49.829580+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: audit 2021-01-27T09:23:49.849662+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: cephadm 2021-01-27T09:23:49.851441+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: cephadm 2021-01-27T09:23:49.854873+0000 mgr.y (mgr.14138) 210 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:23:51.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: audit 2021-01-27T09:23:49.897744+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T09:23:51.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: cluster 2021-01-27T09:23:50.192126+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:51.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:50 smithi103 bash[13570]: audit 2021-01-27T09:23:50.267409+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:23:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- 172.21.15.47:0/1826649675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f3fe0 msgr2=0x7fe8440f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1826649675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f3fe0 0x7fe8440f4460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe83c009dc0 tx=0x7fe83c004d10).stop 2021-01-27T09:23:51.737 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- 172.21.15.47:0/1826649675 shutdown_connections 2021-01-27T09:23:51.737 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1826649675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f3fe0 0x7fe8440f4460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:51.737 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1826649675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 0x7fe8440f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:51.737 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1826649675 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f7800 0x7fe8440f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:51.737 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- 172.21.15.47:0/1826649675 >> 172.21.15.47:0/1826649675 conn(0x7fe8440ef730 msgr2=0x7fe8440f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:23:51.738 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- 172.21.15.47:0/1826649675 shutdown_connections 2021-01-27T09:23:51.738 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- 172.21.15.47:0/1826649675 wait complete. 2021-01-27T09:23:51.739 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 Processor -- start 2021-01-27T09:23:51.739 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- start start 2021-01-27T09:23:51.740 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f3fe0 0x7fe844105690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:51.740 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 0x7fe844105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:51.740 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:51.740 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844106fa0 con 0x7fe8440f7800 2021-01-27T09:23:51.740 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844107110 con 0x7fe8440f6ef0 2021-01-27T09:23:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.740+0000 7fe848f9c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8441072d0 con 0x7fe8440f3fe0 2021-01-27T09:23:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37782/0 (socket says 172.21.15.47:37782) 2021-01-27T09:23:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe8437fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f3fe0 0x7fe844105690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:51.741 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 -- 172.21.15.47:0/1063625615 learned_addr learned my addr 172.21.15.47:0/1063625615 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:23:51.742 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe83bfff700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 0x7fe844105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:51.742 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 -- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f3fe0 msgr2=0x7fe844105690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:51.742 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f3fe0 0x7fe844105690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:51.742 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 -- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 msgr2=0x7fe844105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:23:51.742 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 0x7fe844105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:23:51.743 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 -- 172.21.15.47:0/1063625615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844107490 con 0x7fe8440f7800 2021-01-27T09:23:51.743 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe843fff700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe83c004b70 tx=0x7fe83c004d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:23:51.743 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00e030 con 0x7fe8440f7800 2021-01-27T09:23:51.743 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe83c004e90 con 0x7fe8440f7800 2021-01-27T09:23:51.743 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8441076e0 con 0x7fe8440f7800 2021-01-27T09:23:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c018070 con 0x7fe8440f7800 2021-01-27T09:23:51.744 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84410de80 con 0x7fe8440f7800 2021-01-27T09:23:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8440f33c0 con 0x7fe8440f7800 2021-01-27T09:23:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.744+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fe83c024060 con 0x7fe8440f7800 2021-01-27T09:23:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.748+0000 7fe840ff9700 1 --2- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 0x7fe82405e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:23:51.745 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.748+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3590+0+0 (secure 0 0 0) 0x7fe83c076e60 con 0x7fe8440f7800 2021-01-27T09:23:51.746 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.748+0000 7fe8437fe700 1 --2- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 0x7fe82405e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:23:51.746 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.748+0000 7fe8437fe700 1 --2- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 0x7fe82405e0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe834004ce0 tx=0x7fe83400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:23:51.750 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.756+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe83c04a4e0 con 0x7fe8440f7800 2021-01-27T09:23:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:23:51.948+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe844100620 con 0x7fe82405bc30 2021-01-27T09:23:52.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[9772]: cephadm 2021-01-27T09:23:50.269044+0000 mgr.y (mgr.14138) 212 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:52.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[9772]: audit 2021-01-27T09:23:50.857256+0000 mon.a (mon.0) 475 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T09:23:52.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[9772]: cluster 2021-01-27T09:23:50.857409+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T09:23:52.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[9772]: audit 2021-01-27T09:23:50.857736+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:52.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[9772]: audit 2021-01-27T09:23:50.858706+0000 mon.a (mon.0) 478 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:52.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[13570]: cephadm 2021-01-27T09:23:50.269044+0000 mgr.y (mgr.14138) 212 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:52.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[13570]: audit 2021-01-27T09:23:50.857256+0000 mon.a (mon.0) 475 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T09:23:52.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[13570]: cluster 2021-01-27T09:23:50.857409+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T09:23:52.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[13570]: audit 2021-01-27T09:23:50.857736+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:52.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:51 smithi103 bash[13570]: audit 2021-01-27T09:23:50.858706+0000 mon.a (mon.0) 478 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:52.293 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[9721]: cephadm 2021-01-27T09:23:50.269044+0000 mgr.y (mgr.14138) 212 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:23:52.293 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[9721]: audit 2021-01-27T09:23:50.857256+0000 mon.a (mon.0) 475 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T09:23:52.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[9721]: cluster 2021-01-27T09:23:50.857409+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T09:23:52.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[9721]: audit 2021-01-27T09:23:50.857736+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:52.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[9721]: audit 2021-01-27T09:23:50.858706+0000 mon.a (mon.0) 478 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:23:52.294 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:23:51 smithi047 bash[17579]: debug 2021-01-27T09:23:51.868+0000 7f21a8e50700 -1 osd.6 0 waiting for initial osdmap 2021-01-27T09:23:53.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.861525+0000 mon.a (mon.0) 479 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:53.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: cluster 2021-01-27T09:23:51.861702+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T09:23:53.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.864543+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.873728+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.954889+0000 mgr.y (mgr.14138) 213 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:53.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.956433+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:53.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: cephadm 2021-01-27T09:23:51.958907+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:53.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.959417+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:53.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.960966+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:53.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:51.962933+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:53.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: cluster 2021-01-27T09:23:52.192722+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:53.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: cluster 2021-01-27T09:23:52.864244+0000 mon.a (mon.0) 487 : cluster [INF] osd.6 v2:172.21.15.47:6808/4157251446 boot 2021-01-27T09:23:53.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: cluster 2021-01-27T09:23:52.864374+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T09:23:53.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[9772]: audit 2021-01-27T09:23:52.864624+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.861525+0000 mon.a (mon.0) 479 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:53.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: cluster 2021-01-27T09:23:51.861702+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T09:23:53.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.864543+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.873728+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.954889+0000 mgr.y (mgr.14138) 213 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:53.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.956433+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:53.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: cephadm 2021-01-27T09:23:51.958907+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:53.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.959417+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:53.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.960966+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:53.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:51.962933+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:53.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: cluster 2021-01-27T09:23:52.192722+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:53.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: cluster 2021-01-27T09:23:52.864244+0000 mon.a (mon.0) 487 : cluster [INF] osd.6 v2:172.21.15.47:6808/4157251446 boot 2021-01-27T09:23:53.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: cluster 2021-01-27T09:23:52.864374+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T09:23:53.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:52 smithi103 bash[13570]: audit 2021-01-27T09:23:52.864624+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.293 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.861525+0000 mon.a (mon.0) 479 : audit [INF] from='osd.6 v2:172.21.15.47:6808/4157251446' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:23:53.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: cluster 2021-01-27T09:23:51.861702+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T09:23:53.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.864543+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.873728+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:53.294 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.954889+0000 mgr.y (mgr.14138) 213 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:23:53.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.956433+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T09:23:53.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: cephadm 2021-01-27T09:23:51.958907+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Applying drive group None on host smithi047... 2021-01-27T09:23:53.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.959417+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T09:23:53.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.960966+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:23:53.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:51.962933+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:23:53.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: cluster 2021-01-27T09:23:52.192722+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T09:23:53.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: cluster 2021-01-27T09:23:52.864244+0000 mon.a (mon.0) 487 : cluster [INF] osd.6 v2:172.21.15.47:6808/4157251446 boot 2021-01-27T09:23:53.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: cluster 2021-01-27T09:23:52.864374+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T09:23:53.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:52 smithi047 bash[9721]: audit 2021-01-27T09:23:52.864624+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T09:23:54.043 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:53 smithi047 bash[9721]: cluster 2021-01-27T09:23:50.871071+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:54.044 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:53 smithi047 bash[9721]: cluster 2021-01-27T09:23:50.871244+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:54.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:53 smithi103 bash[9772]: cluster 2021-01-27T09:23:50.871071+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:54.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:53 smithi103 bash[9772]: cluster 2021-01-27T09:23:50.871244+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:54.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:53 smithi103 bash[13570]: cluster 2021-01-27T09:23:50.871071+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:23:54.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:53 smithi103 bash[13570]: cluster 2021-01-27T09:23:50.871244+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:23:55.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:54 smithi103 bash[9772]: cluster 2021-01-27T09:23:53.880240+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T09:23:55.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:54 smithi103 bash[9772]: cluster 2021-01-27T09:23:54.193279+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:55.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:54 smithi103 bash[13570]: cluster 2021-01-27T09:23:53.880240+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T09:23:55.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:54 smithi103 bash[13570]: cluster 2021-01-27T09:23:54.193279+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:55.281 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:54 smithi047 bash[9721]: cluster 2021-01-27T09:23:53.880240+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T09:23:55.281 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:54 smithi047 bash[9721]: cluster 2021-01-27T09:23:54.193279+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:56.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:56 smithi047 bash[9721]: audit 2021-01-27T09:23:56.142142+0000 mon.a (mon.0) 491 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:56 smithi047 bash[9721]: audit 2021-01-27T09:23:56.143034+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.47:0/1545686749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:56 smithi047 bash[9721]: audit 2021-01-27T09:23:56.150448+0000 mon.a (mon.0) 492 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]': finished 2021-01-27T09:23:56.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:56 smithi047 bash[9721]: cluster 2021-01-27T09:23:56.150625+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T09:23:56.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:56 smithi047 bash[9721]: audit 2021-01-27T09:23:56.150998+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:23:56.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[9772]: audit 2021-01-27T09:23:56.142142+0000 mon.a (mon.0) 491 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[9772]: audit 2021-01-27T09:23:56.143034+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.47:0/1545686749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[9772]: audit 2021-01-27T09:23:56.150448+0000 mon.a (mon.0) 492 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]': finished 2021-01-27T09:23:56.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[9772]: cluster 2021-01-27T09:23:56.150625+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T09:23:56.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[9772]: audit 2021-01-27T09:23:56.150998+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:23:56.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[13570]: audit 2021-01-27T09:23:56.142142+0000 mon.a (mon.0) 491 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[13570]: audit 2021-01-27T09:23:56.143034+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.47:0/1545686749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]: dispatch 2021-01-27T09:23:56.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[13570]: audit 2021-01-27T09:23:56.150448+0000 mon.a (mon.0) 492 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6c2ce68-a2c6-4b28-953c-4b1f08268400"}]': finished 2021-01-27T09:23:56.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[13570]: cluster 2021-01-27T09:23:56.150625+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T09:23:56.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:56 smithi103 bash[13570]: audit 2021-01-27T09:23:56.150998+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:23:57.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:57 smithi047 bash[9721]: cluster 2021-01-27T09:23:56.193854+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:57.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:57 smithi047 bash[9721]: audit 2021-01-27T09:23:56.778791+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.47:0/2232629197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:57.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:57 smithi103 bash[9772]: cluster 2021-01-27T09:23:56.193854+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:57.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:57 smithi103 bash[9772]: audit 2021-01-27T09:23:56.778791+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.47:0/2232629197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:57.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:57 smithi103 bash[13570]: cluster 2021-01-27T09:23:56.193854+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:57.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:57 smithi103 bash[13570]: audit 2021-01-27T09:23:56.778791+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.47:0/2232629197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T09:23:59.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:59 smithi047 bash[9721]: cluster 2021-01-27T09:23:58.194449+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:59.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:59 smithi047 bash[9721]: audit 2021-01-27T09:23:58.327295+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:23:59.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:23:59 smithi047 bash[9721]: audit 2021-01-27T09:23:58.330886+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:23:59.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[9772]: cluster 2021-01-27T09:23:58.194449+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:59.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[9772]: audit 2021-01-27T09:23:58.327295+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:23:59.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[9772]: audit 2021-01-27T09:23:58.330886+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:23:59.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[13570]: cluster 2021-01-27T09:23:58.194449+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:23:59.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[13570]: audit 2021-01-27T09:23:58.327295+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:23:59.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:23:59 smithi103 bash[13570]: audit 2021-01-27T09:23:58.330886+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:24:00.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:00 smithi047 bash[9721]: audit 2021-01-27T09:23:59.986186+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:00.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:00 smithi103 bash[9772]: audit 2021-01-27T09:23:59.986186+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:00.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:00 smithi103 bash[13570]: audit 2021-01-27T09:23:59.986186+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:01.495 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:01 smithi047 bash[9721]: cluster 2021-01-27T09:24:00.194993+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:01.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:01 smithi103 bash[9772]: cluster 2021-01-27T09:24:00.194993+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:01.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:01 smithi103 bash[13570]: cluster 2021-01-27T09:24:00.194993+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:02.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:02 smithi047 bash[9721]: cluster 2021-01-27T09:24:02.195563+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:02.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:02 smithi103 bash[9772]: cluster 2021-01-27T09:24:02.195563+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:02.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:02 smithi103 bash[13570]: cluster 2021-01-27T09:24:02.195563+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:04.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:04 smithi047 bash[9721]: cluster 2021-01-27T09:24:04.196157+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:04.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:04 smithi103 bash[9772]: cluster 2021-01-27T09:24:04.196157+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:04.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:04 smithi103 bash[13570]: cluster 2021-01-27T09:24:04.196157+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:05.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:05 smithi047 bash[9721]: audit 2021-01-27T09:24:04.678536+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T09:24:05.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:05 smithi047 bash[9721]: audit 2021-01-27T09:24:04.680463+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:05.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:05 smithi047 bash[9721]: cephadm 2021-01-27T09:24:04.681926+0000 mgr.y (mgr.14138) 222 : cephadm [INF] Deploying daemon osd.7 on smithi047 2021-01-27T09:24:05.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:05 smithi047 bash[9721]: audit 2021-01-27T09:24:04.682812+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T09:24:05.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[9772]: audit 2021-01-27T09:24:04.678536+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T09:24:05.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[9772]: audit 2021-01-27T09:24:04.680463+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:05.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[9772]: cephadm 2021-01-27T09:24:04.681926+0000 mgr.y (mgr.14138) 222 : cephadm [INF] Deploying daemon osd.7 on smithi047 2021-01-27T09:24:05.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[9772]: audit 2021-01-27T09:24:04.682812+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T09:24:05.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[13570]: audit 2021-01-27T09:24:04.678536+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T09:24:05.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[13570]: audit 2021-01-27T09:24:04.680463+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:05.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[13570]: cephadm 2021-01-27T09:24:04.681926+0000 mgr.y (mgr.14138) 222 : cephadm [INF] Deploying daemon osd.7 on smithi047 2021-01-27T09:24:05.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:05 smithi103 bash[13570]: audit 2021-01-27T09:24:04.682812+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T09:24:06.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:06 smithi047 bash[9721]: cluster 2021-01-27T09:24:06.196743+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:06.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:06 smithi103 bash[9772]: cluster 2021-01-27T09:24:06.196743+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:06.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:06 smithi103 bash[13570]: cluster 2021-01-27T09:24:06.196743+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:07.481 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.484+0000 7fe840ff9700 1 -- 172.21.15.47:0/1063625615 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe844100620 con 0x7fe82405bc30 2021-01-27T09:24:07.481 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 7 on host 'smithi047' 2021-01-27T09:24:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 msgr2=0x7fe82405e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 0x7fe82405e0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe834004ce0 tx=0x7fe83400b040).stop 2021-01-27T09:24:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 msgr2=0x7fe844106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe83c004b70 tx=0x7fe83c004d10).stop 2021-01-27T09:24:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 shutdown_connections 2021-01-27T09:24:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe82405bc30 0x7fe82405e0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8440f7800 0x7fe844106a70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8440f3fe0 0x7fe844105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 --2- 172.21.15.47:0/1063625615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8440f6ef0 0x7fe844105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 >> 172.21.15.47:0/1063625615 conn(0x7fe8440ef730 msgr2=0x7fe8440f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 shutdown_connections 2021-01-27T09:24:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:07.488+0000 7fe848f9c700 1 -- 172.21.15.47:0/1063625615 wait complete. 2021-01-27T09:24:07.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:07 smithi047 bash[9721]: audit 2021-01-27T09:24:07.478123+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:07.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:07 smithi047 bash[9721]: audit 2021-01-27T09:24:07.483658+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:07.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:07 smithi103 bash[9772]: audit 2021-01-27T09:24:07.478123+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:07.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:07 smithi103 bash[9772]: audit 2021-01-27T09:24:07.483658+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:07.888 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:07 smithi103 bash[13570]: audit 2021-01-27T09:24:07.478123+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:07.888 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:07 smithi103 bash[13570]: audit 2021-01-27T09:24:07.483658+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:08.887 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:08 smithi103 bash[13570]: cluster 2021-01-27T09:24:08.197334+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:08.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:08 smithi103 bash[9772]: cluster 2021-01-27T09:24:08.197334+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:09.033 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:08 smithi047 bash[9721]: cluster 2021-01-27T09:24:08.197334+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:09.437 DEBUG:teuthology.orchestra.run.smithi047:osd.7> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@osd.7.service 2021-01-27T09:24:09.440 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi103 2021-01-27T09:24:09.441 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2021-01-27T09:24:09.535 INFO:journalctl@ceph.osd.7.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:24:09.720 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:09 smithi047 bash[9721]: audit 2021-01-27T09:24:08.652112+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:09.721 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:09 smithi047 bash[9721]: audit 2021-01-27T09:24:08.653980+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:10.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:09 smithi103 bash[9772]: audit 2021-01-27T09:24:08.652112+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:10.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:09 smithi103 bash[9772]: audit 2021-01-27T09:24:08.653980+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:10.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:09 smithi103 bash[13570]: audit 2021-01-27T09:24:08.652112+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:10.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:09 smithi103 bash[13570]: audit 2021-01-27T09:24:08.653980+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T09:24:10.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[9721]: cluster 2021-01-27T09:24:10.197992+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:11.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:10 smithi103 bash[9772]: cluster 2021-01-27T09:24:10.197992+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:11.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:10 smithi103 bash[13570]: cluster 2021-01-27T09:24:10.197992+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:11.293 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T09:24:11.293 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-01-27T09:24:11.294 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-01-27T09:24:11.294 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-01-27T09:24:11.294 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T09:24:11.294 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T09:24:11.295 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:10 smithi047 bash[19698]: --> ceph-volume lvm activate successful for osd ID: 7 2021-01-27T09:24:12.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:12 smithi103 bash[9772]: cluster 2021-01-27T09:24:12.198645+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:12.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:12 smithi103 bash[13570]: cluster 2021-01-27T09:24:12.198645+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:12.721 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:12 smithi047 bash[9721]: cluster 2021-01-27T09:24:12.198645+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:14.625 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:14 smithi047 bash[9721]: cluster 2021-01-27T09:24:14.199305+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:14.637 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:14 smithi103 bash[13570]: cluster 2021-01-27T09:24:14.199305+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:14.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:14 smithi103 bash[9772]: cluster 2021-01-27T09:24:14.199305+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:15.392 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 msgr2=0x55943a6cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T09:24:15.392 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 msgr2=0x55943a6cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T09:24:15.393 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_read_frame_preamble_main r=0 2021-01-27T09:24:15.393 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_MESSAGE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).throttle_message 2021-01-27T09:24:15.393 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_BYTES pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).throttle_bytes 2021-01-27T09:24:15.393 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).throttle_dispatch_queue 2021-01-27T09:24:15.394 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).read_frame_segment seg_idx=0 2021-01-27T09:24:15.394 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).read_frame_segment seg_idx=1 2021-01-27T09:24:15.394 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 msgr2=0x55943a6cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T09:24:15.394 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_read_frame_segment r=0 2021-01-27T09:24:15.395 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 msgr2=0x55943a6cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T09:24:15.395 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_read_frame_epilogue_main r=0 2021-01-27T09:24:15.395 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 10 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_read_frame_dispatch tag=17 2021-01-27T09:24:15.395 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_message 2021-01-27T09:24:15.396 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 5 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T09:24:15.396 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 5 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).handle_message received message m=0x55943a6e44e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T09:24:15.396 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 queue 0x55943a6e44e0 prio 196 2021-01-27T09:24:15.396 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 --2- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 0x55943a6cf400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x55943a6dfe60 tx=0x55943a714d80).read_frame 2021-01-27T09:24:15.396 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1337c5a700 20 -- 172.21.15.47:0/1846702276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55943a762c00 msgr2=0x55943a6cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T09:24:15.397 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1336c58700 1 -- 172.21.15.47:0/1846702276 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55943a6e44e0 con 0x55943a762c00 2021-01-27T09:24:15.397 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1336c58700 10 -- 172.21.15.47:0/1846702276 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T09:24:15.397 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.176+0000 7f1336c58700 20 -- 172.21.15.47:0/1846702276 done calling dispatch on 0x55943a6e44e0 2021-01-27T09:24:15.793 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:15 smithi047 bash[20041]: debug 2021-01-27T09:24:15.468+0000 7f133e6e3200 -1 Falling back to public interface 2021-01-27T09:24:16.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:16 smithi047 bash[9721]: cluster 2021-01-27T09:24:16.199914+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:16.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:16 smithi103 bash[9772]: cluster 2021-01-27T09:24:16.199914+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:16.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:16 smithi103 bash[13570]: cluster 2021-01-27T09:24:16.199914+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:18.329 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2021-01-27T09:24:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "id": "69291381-da6a-4497-94fa-f4f42c1f590e", 2021-01-27T09:24:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "realm", 2021-01-27T09:24:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "current_period": "a61a58c4-9fdd-4521-a813-61cadc7fe78d", 2021-01-27T09:24:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 1 2021-01-27T09:24:18.331 INFO:teuthology.orchestra.run.smithi047.stdout:} 2021-01-27T09:24:18.542 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[20041]: debug 2021-01-27T09:24:18.512+0000 7f133e6e3200 -1 osd.7 0 log_to_monitors {default=true} 2021-01-27T09:24:18.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: cluster 2021-01-27T09:24:17.279888+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T09:24:18.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.280169+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:18.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.284783+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.47:0/580621032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.287547+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.591288+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.963831+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.971303+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: cephadm 2021-01-27T09:24:17.973125+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: audit 2021-01-27T09:24:17.982147+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: cephadm 2021-01-27T09:24:17.983459+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:18 smithi047 bash[9721]: cluster 2021-01-27T09:24:18.200555+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v194: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:18.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: cluster 2021-01-27T09:24:17.279888+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T09:24:18.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.280169+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:18.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.284783+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.47:0/580621032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.287547+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.591288+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:18.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.963831+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.971303+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: cephadm 2021-01-27T09:24:17.973125+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: audit 2021-01-27T09:24:17.982147+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: cephadm 2021-01-27T09:24:17.983459+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[13570]: cluster 2021-01-27T09:24:18.200555+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v194: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:18.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: cluster 2021-01-27T09:24:17.279888+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T09:24:18.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.280169+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:18.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.284783+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.47:0/580621032' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.287547+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T09:24:18.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.591288+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:18.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.963831+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.971303+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: cephadm 2021-01-27T09:24:17.973125+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: audit 2021-01-27T09:24:17.982147+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:18.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: cephadm 2021-01-27T09:24:17.983459+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:18.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:18 smithi103 bash[9772]: cluster 2021-01-27T09:24:18.200555+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v194: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:19.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2021-01-27T09:24:19.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:19 smithi047 bash[9721]: audit 2021-01-27T09:24:18.282688+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T09:24:19.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:19 smithi047 bash[9721]: cluster 2021-01-27T09:24:18.282823+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T09:24:19.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:19 smithi047 bash[9721]: audit 2021-01-27T09:24:18.287738+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:19.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:19 smithi047 bash[9721]: audit 2021-01-27T09:24:18.522712+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:19.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:19 smithi047 bash[9721]: audit 2021-01-27T09:24:18.524211+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:19.638 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[13570]: audit 2021-01-27T09:24:18.282688+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T09:24:19.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[13570]: cluster 2021-01-27T09:24:18.282823+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T09:24:19.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[13570]: audit 2021-01-27T09:24:18.287738+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:19.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[13570]: audit 2021-01-27T09:24:18.522712+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:19.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[13570]: audit 2021-01-27T09:24:18.524211+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:19.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[9772]: audit 2021-01-27T09:24:18.282688+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T09:24:19.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[9772]: cluster 2021-01-27T09:24:18.282823+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T09:24:19.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[9772]: audit 2021-01-27T09:24:18.287738+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:19.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[9772]: audit 2021-01-27T09:24:18.522712+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:19.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:19 smithi103 bash[9772]: audit 2021-01-27T09:24:18.524211+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T09:24:20.609 INFO:journalctl@ceph.osd.7.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[20041]: debug 2021-01-27T09:24:20.324+0000 7f1336457700 -1 osd.7 0 waiting for initial osdmap 2021-01-27T09:24:20.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: audit 2021-01-27T09:24:19.297165+0000 mon.a (mon.0) 516 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T09:24:20.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: cluster 2021-01-27T09:24:19.297436+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T09:24:20.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: audit 2021-01-27T09:24:19.298389+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:20.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: audit 2021-01-27T09:24:19.301875+0000 mon.b (mon.2) 15 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.611 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: audit 2021-01-27T09:24:19.307417+0000 mon.a (mon.0) 519 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.611 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:20 smithi047 bash[9721]: cluster 2021-01-27T09:24:20.201226+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 5 creating+activating, 6 creating+peering, 22 active+clean; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:20.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: audit 2021-01-27T09:24:19.297165+0000 mon.a (mon.0) 516 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T09:24:20.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: cluster 2021-01-27T09:24:19.297436+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T09:24:20.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: audit 2021-01-27T09:24:19.298389+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:20.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: audit 2021-01-27T09:24:19.301875+0000 mon.b (mon.2) 15 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: audit 2021-01-27T09:24:19.307417+0000 mon.a (mon.0) 519 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[9772]: cluster 2021-01-27T09:24:20.201226+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 5 creating+activating, 6 creating+peering, 22 active+clean; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:20.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: audit 2021-01-27T09:24:19.297165+0000 mon.a (mon.0) 516 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T09:24:20.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: cluster 2021-01-27T09:24:19.297436+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T09:24:20.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: audit 2021-01-27T09:24:19.298389+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:20.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: audit 2021-01-27T09:24:19.301875+0000 mon.b (mon.2) 15 : audit [INF] from='osd.7 v2:172.21.15.47:6812/1597879315' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: audit 2021-01-27T09:24:19.307417+0000 mon.a (mon.0) 519 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2021-01-27T09:24:20.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:20 smithi103 bash[13570]: cluster 2021-01-27T09:24:20.201226+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 5 creating+activating, 6 creating+peering, 22 active+clean; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T09:24:21.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: audit 2021-01-27T09:24:20.311619+0000 mon.a (mon.0) 520 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:24:21.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: cluster 2021-01-27T09:24:20.311827+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T09:24:21.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: audit 2021-01-27T09:24:20.313164+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: audit 2021-01-27T09:24:20.327535+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: cluster 2021-01-27T09:24:21.315213+0000 mon.a (mon.0) 524 : cluster [INF] osd.7 v2:172.21.15.47:6812/1597879315 boot 2021-01-27T09:24:21.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: cluster 2021-01-27T09:24:21.315388+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T09:24:21.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[9772]: audit 2021-01-27T09:24:21.316033+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: audit 2021-01-27T09:24:20.311619+0000 mon.a (mon.0) 520 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:24:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: cluster 2021-01-27T09:24:20.311827+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T09:24:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: audit 2021-01-27T09:24:20.313164+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: audit 2021-01-27T09:24:20.327535+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: cluster 2021-01-27T09:24:21.315213+0000 mon.a (mon.0) 524 : cluster [INF] osd.7 v2:172.21.15.47:6812/1597879315 boot 2021-01-27T09:24:21.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: cluster 2021-01-27T09:24:21.315388+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T09:24:21.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:21 smithi103 bash[13570]: audit 2021-01-27T09:24:21.316033+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: audit 2021-01-27T09:24:20.311619+0000 mon.a (mon.0) 520 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2021-01-27T09:24:21.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: cluster 2021-01-27T09:24:20.311827+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T09:24:21.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: audit 2021-01-27T09:24:20.313164+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: audit 2021-01-27T09:24:20.327535+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:21.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: cluster 2021-01-27T09:24:21.315213+0000 mon.a (mon.0) 524 : cluster [INF] osd.7 v2:172.21.15.47:6812/1597879315 boot 2021-01-27T09:24:21.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: cluster 2021-01-27T09:24:21.315388+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T09:24:21.794 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:21 smithi047 bash[9721]: audit 2021-01-27T09:24:21.316033+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T09:24:22.616 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2021-01-27T09:24:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "id": "b0e784e6-3e4e-4126-8dc7-3314dc5eea3c", 2021-01-27T09:24:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default", 2021-01-27T09:24:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "api_name": "default", 2021-01-27T09:24:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "is_master": "true", 2021-01-27T09:24:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "endpoints": [], 2021-01-27T09:24:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "hostnames": [], 2021-01-27T09:24:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "hostnames_s3website": [], 2021-01-27T09:24:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "master_zone": "", 2021-01-27T09:24:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "zones": [], 2021-01-27T09:24:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "placement_targets": [], 2021-01-27T09:24:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_placement": "", 2021-01-27T09:24:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "realm_id": "69291381-da6a-4497-94fa-f4f42c1f590e", 2021-01-27T09:24:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "sync_policy": { 2021-01-27T09:24:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "groups": [] 2021-01-27T09:24:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2021-01-27T09:24:22.620 INFO:teuthology.orchestra.run.smithi047.stdout:} 2021-01-27T09:24:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[9772]: cluster 2021-01-27T09:24:19.565510+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:24:22.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[9772]: cluster 2021-01-27T09:24:19.565748+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:24:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[9772]: cluster 2021-01-27T09:24:22.201881+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 2 peering, 5 creating+activating, 4 creating+peering, 22 active+clean; 373 B data, 41 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:24:22.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[9772]: cluster 2021-01-27T09:24:22.319186+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T09:24:22.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[13570]: cluster 2021-01-27T09:24:19.565510+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:24:22.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[13570]: cluster 2021-01-27T09:24:19.565748+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:24:22.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[13570]: cluster 2021-01-27T09:24:22.201881+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 2 peering, 5 creating+activating, 4 creating+peering, 22 active+clean; 373 B data, 41 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:24:22.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:22 smithi103 bash[13570]: cluster 2021-01-27T09:24:22.319186+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T09:24:22.664 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:22 smithi047 bash[9721]: cluster 2021-01-27T09:24:19.565510+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T09:24:22.665 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:22 smithi047 bash[9721]: cluster 2021-01-27T09:24:19.565748+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T09:24:22.665 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:22 smithi047 bash[9721]: cluster 2021-01-27T09:24:22.201881+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 2 peering, 5 creating+activating, 4 creating+peering, 22 active+clean; 373 B data, 41 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:24:22.665 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:22 smithi047 bash[9721]: cluster 2021-01-27T09:24:22.319186+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T09:24:23.477 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2021-01-27T09:24:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:24 smithi103 bash[9772]: audit 2021-01-27T09:24:23.327407+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:24.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:24 smithi103 bash[9772]: cluster 2021-01-27T09:24:24.202739+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 465 B data, 42 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 25 B/s, 0 objects/s recovering 2021-01-27T09:24:24.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:24 smithi103 bash[13570]: audit 2021-01-27T09:24:23.327407+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:24.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:24 smithi103 bash[13570]: cluster 2021-01-27T09:24:24.202739+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 465 B data, 42 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 25 B/s, 0 objects/s recovering 2021-01-27T09:24:24.768 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:24 smithi047 bash[9721]: audit 2021-01-27T09:24:23.327407+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:24.769 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:24 smithi047 bash[9721]: cluster 2021-01-27T09:24:24.202739+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 465 B data, 42 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s; 25 B/s, 0 objects/s recovering 2021-01-27T09:24:26.543 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:26 smithi047 bash[9721]: cluster 2021-01-27T09:24:26.203445+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 675 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 853 B/s wr, 1 op/s; 69 B/s, 0 objects/s recovering 2021-01-27T09:24:26.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:26 smithi103 bash[9772]: cluster 2021-01-27T09:24:26.203445+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 675 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 853 B/s wr, 1 op/s; 69 B/s, 0 objects/s recovering 2021-01-27T09:24:26.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:26 smithi103 bash[13570]: cluster 2021-01-27T09:24:26.203445+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 2 peering, 1 creating+activating, 30 active+clean; 675 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 853 B/s wr, 1 op/s; 69 B/s, 0 objects/s recovering 2021-01-27T09:24:26.896 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2021-01-27T09:24:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "id": "124aeeb5-2341-4236-8a37-0e3d4f809f56", 2021-01-27T09:24:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zone", 2021-01-27T09:24:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "domain_root": "zone.rgw.meta:root", 2021-01-27T09:24:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "control_pool": "zone.rgw.control", 2021-01-27T09:24:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "gc_pool": "zone.rgw.log:gc", 2021-01-27T09:24:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "lc_pool": "zone.rgw.log:lc", 2021-01-27T09:24:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "log_pool": "zone.rgw.log", 2021-01-27T09:24:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "intent_log_pool": "zone.rgw.log:intent", 2021-01-27T09:24:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "usage_log_pool": "zone.rgw.log:usage", 2021-01-27T09:24:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "roles_pool": "zone.rgw.meta:roles", 2021-01-27T09:24:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "reshard_pool": "zone.rgw.log:reshard", 2021-01-27T09:24:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2021-01-27T09:24:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2021-01-27T09:24:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2021-01-27T09:24:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2021-01-27T09:24:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "otp_pool": "zone.rgw.otp", 2021-01-27T09:24:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "system_key": { 2021-01-27T09:24:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "access_key": "", 2021-01-27T09:24:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "secret_key": "" 2021-01-27T09:24:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2021-01-27T09:24:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "placement_pools": [ 2021-01-27T09:24:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2021-01-27T09:24:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "default-placement", 2021-01-27T09:24:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "val": { 2021-01-27T09:24:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "index_pool": "zone.rgw.buckets.index", 2021-01-27T09:24:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_classes": { 2021-01-27T09:24:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "STANDARD": { 2021-01-27T09:24:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "data_pool": "zone.rgw.buckets.data" 2021-01-27T09:24:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2021-01-27T09:24:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2021-01-27T09:24:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2021-01-27T09:24:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "index_type": 0 2021-01-27T09:24:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2021-01-27T09:24:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2021-01-27T09:24:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2021-01-27T09:24:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "realm_id": "69291381-da6a-4497-94fa-f4f42c1f590e", 2021-01-27T09:24:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "notif_pool": "zone.rgw.log:notif" 2021-01-27T09:24:26.905 INFO:teuthology.orchestra.run.smithi047.stdout:} 2021-01-27T09:24:27.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi103=realm.zone.a' 2021-01-27T09:24:28.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:28 smithi047 bash[9721]: cluster 2021-01-27T09:24:28.204099+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 259 B/s rd, 1.0 KiB/s wr, 1 op/s; 66 B/s, 0 objects/s recovering 2021-01-27T09:24:28.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:28 smithi103 bash[9772]: cluster 2021-01-27T09:24:28.204099+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 259 B/s rd, 1.0 KiB/s wr, 1 op/s; 66 B/s, 0 objects/s recovering 2021-01-27T09:24:28.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:28 smithi103 bash[13570]: cluster 2021-01-27T09:24:28.204099+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 259 B/s rd, 1.0 KiB/s wr, 1 op/s; 66 B/s, 0 objects/s recovering 2021-01-27T09:24:30.544 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:30 smithi047 bash[9721]: cluster 2021-01-27T09:24:30.204858+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 1.3 KiB/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2021-01-27T09:24:30.640 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:30 smithi103 bash[9772]: cluster 2021-01-27T09:24:30.204858+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 1.3 KiB/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2021-01-27T09:24:30.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:30 smithi103 bash[13570]: cluster 2021-01-27T09:24:30.204858+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 1.3 KiB/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2021-01-27T09:24:31.075 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 -- 172.21.15.47:0/1897120481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 msgr2=0x7fa3bc0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 --2- 172.21.15.47:0/1897120481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc0fffc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa3b4009dc0 tx=0x7fa3b4004d10).stop 2021-01-27T09:24:31.076 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 -- 172.21.15.47:0/1897120481 shutdown_connections 2021-01-27T09:24:31.077 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 --2- 172.21.15.47:0/1897120481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc0fffc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.077 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 --2- 172.21.15.47:0/1897120481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc0f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.077 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 --2- 172.21.15.47:0/1897120481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 0x7fa3bc0f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.078 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 -- 172.21.15.47:0/1897120481 >> 172.21.15.47:0/1897120481 conn(0x7fa3bc0f3550 msgr2=0x7fa3bc0f5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:31.078 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 -- 172.21.15.47:0/1897120481 shutdown_connections 2021-01-27T09:24:31.079 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.078+0000 7fa3c216b700 1 -- 172.21.15.47:0/1897120481 wait complete. 2021-01-27T09:24:31.081 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 Processor -- start 2021-01-27T09:24:31.082 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- start start 2021-01-27T09:24:31.082 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:31.082 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 0x7fa3bc107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc108e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1093b0 con 0x7fa3bc0f96c0 2021-01-27T09:24:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc109520 con 0x7fa3bc0f8d70 2021-01-27T09:24:31.083 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1096e0 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c196a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc108e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.47:34852/0 (socket says 172.21.15.47:34852) 2021-01-27T09:24:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 -- 172.21.15.47:0/3510880633 learned_addr learned my addr 172.21.15.47:0/3510880633 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:24:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c0968700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 0x7fa3bc107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 -- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 msgr2=0x7fa3bc107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 0x7fa3bc107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.086 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 -- 172.21.15.47:0/3510880633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 msgr2=0x7fa3bc108e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:31.086 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc108e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.086 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 -- 172.21.15.47:0/3510880633 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc1098a0 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.087 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c1169700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa3b800eb90 tx=0x7fa3b800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:31.087 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80092e0 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.087 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc109b50 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.088 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc1102e0 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.088 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fa3b800f040 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.088 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.082+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800c840 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.088 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.086+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c004da0 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.089 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.086+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fa3b801b030 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.090 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.086+0000 7fa3b1ffb700 1 --2- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 0x7fa3a805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.086+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4397+0+0 (secure 0 0 0) 0x7fa3b8075340 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.086+0000 7fa3c0968700 1 --2- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 0x7fa3a805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.090+0000 7fa3c0968700 1 --2- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 0x7fa3a805e0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa3ac009fd0 tx=0x7fa3ac00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.094+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fa3b8048470 con 0x7fa3bc0f7ad0 2021-01-27T09:24:31.284 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.290+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi103=realm.zone.a", "target": ["mon-mgr", ""]}) v1 -- 0x7fa39c000c60 con 0x7fa3a805bc30 2021-01-27T09:24:31.296 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.302+0000 7fa3b1ffb700 1 -- 172.21.15.47:0/3510880633 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7fa39c000c60 con 0x7fa3a805bc30 2021-01-27T09:24:31.297 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled rgw.realm.zone update... 2021-01-27T09:24:31.300 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 msgr2=0x7fa3a805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:31.300 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 0x7fa3a805e0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa3ac009fd0 tx=0x7fa3ac00b040).stop 2021-01-27T09:24:31.300 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 msgr2=0x7fa3bc107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:31.301 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa3b800eb90 tx=0x7fa3b800b040).stop 2021-01-27T09:24:31.301 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 shutdown_connections 2021-01-27T09:24:31.301 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> v2:172.21.15.103:6800/3303543367 conn(0x7fa3a805bc30 0x7fa3a805e0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.301 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3bc0f96c0 0x7fa3bc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.301 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3bc0f7ad0 0x7fa3bc107aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.302 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 --2- 172.21.15.47:0/3510880633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc0f8d70 0x7fa3bc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:31.302 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 >> 172.21.15.47:0/3510880633 conn(0x7fa3bc0f3550 msgr2=0x7fa3bc0fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:31.302 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 shutdown_connections 2021-01-27T09:24:31.302 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:31.306+0000 7fa3c216b700 1 -- 172.21.15.47:0/3510880633 wait complete. 2021-01-27T09:24:32.128 DEBUG:teuthology.orchestra.run.smithi103:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@rgw.realm.zone.a.service 2021-01-27T09:24:32.131 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi047 2021-01-27T09:24:32.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-01-27T09:24:32.358 INFO:journalctl@ceph.rgw.realm.zone.a.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:24:32.438 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.291267+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi103=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:32.439 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:31.293240+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.439 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.299925+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.439 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:31.302357+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:24:32.440 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.736706+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.440 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:31.738503+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:32.441 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:31.740034+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] 2021-01-27T09:24:32.441 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.741422+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:24:32.441 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.743066+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.442 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:31.751140+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T09:24:32.442 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.012498+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.443 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.024466+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.443 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.033706+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.444 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:32.035000+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.444 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.041482+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.444 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.043031+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.444 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.044720+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:32.444 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cephadm 2021-01-27T09:24:32.045873+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi103 2021-01-27T09:24:32.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: audit 2021-01-27T09:24:32.046946+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:32.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[13570]: cluster 2021-01-27T09:24:32.205750+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s; 52 B/s, 0 objects/s recovering 2021-01-27T09:24:32.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.291267+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi103=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:32.445 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:31.293240+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.299925+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:31.302357+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:24:32.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.736706+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.446 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:31.738503+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:32.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:31.740034+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] 2021-01-27T09:24:32.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.741422+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:24:32.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.743066+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.447 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:31.751140+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T09:24:32.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.012498+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.024466+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.033706+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.448 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:32.035000+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.041482+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.043031+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.044720+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:32.449 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cephadm 2021-01-27T09:24:32.045873+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi103 2021-01-27T09:24:32.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: audit 2021-01-27T09:24:32.046946+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:32.450 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:32 smithi103 bash[9772]: cluster 2021-01-27T09:24:32.205750+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s; 52 B/s, 0 objects/s recovering 2021-01-27T09:24:32.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.291267+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi103=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:32.545 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:31.293240+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.299925+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:31.302357+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:24:32.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.736706+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:31.738503+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:32.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:31.740034+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] 2021-01-27T09:24:32.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.741422+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:24:32.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.743066+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:31.751140+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T09:24:32.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.012498+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.024466+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.033706+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:32.035000+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi103=realm.zone.a;count:1 2021-01-27T09:24:32.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.041482+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:32.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.043031+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T09:24:32.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.044720+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:32.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cephadm 2021-01-27T09:24:32.045873+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi103 2021-01-27T09:24:32.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: audit 2021-01-27T09:24:32.046946+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:32.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:32 smithi047 bash[9721]: cluster 2021-01-27T09:24:32.205750+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s; 52 B/s, 0 objects/s recovering 2021-01-27T09:24:34.640 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:34 smithi103 bash[13570]: audit 2021-01-27T09:24:33.336040+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:34.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:34 smithi103 bash[13570]: cluster 2021-01-27T09:24:34.206671+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 688 B/s rd, 1.0 KiB/s wr, 2 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T09:24:34.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:34 smithi103 bash[9772]: audit 2021-01-27T09:24:33.336040+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:34.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:34 smithi103 bash[9772]: cluster 2021-01-27T09:24:34.206671+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 688 B/s rd, 1.0 KiB/s wr, 2 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T09:24:34.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:34 smithi047 bash[9721]: audit 2021-01-27T09:24:33.336040+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:34.795 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:34 smithi047 bash[9721]: cluster 2021-01-27T09:24:34.206671+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 688 B/s rd, 1.0 KiB/s wr, 2 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T09:24:35.140 INFO:journalctl@ceph.rgw.realm.zone.a.smithi103.stdout:Jan 27 09:24:34 smithi103 systemd[1]: Started Ceph rgw.realm.zone.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:24:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/1962210385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3500f67e0 msgr2=0x7fb3500f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- 172.21.15.47:0/1962210385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3500f67e0 0x7fb3500f8c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb34c009dc0 tx=0x7fb34c004d10).stop 2021-01-27T09:24:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/1962210385 shutdown_connections 2021-01-27T09:24:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- 172.21.15.47:0/1962210385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f9290 0x7fb3500f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- 172.21.15.47:0/1962210385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb35005f810 0x7fb3500f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- 172.21.15.47:0/1962210385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3500f67e0 0x7fb3500f8c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/1962210385 >> 172.21.15.47:0/1962210385 conn(0x7fb3500eff70 msgr2=0x7fb3500f23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/1962210385 shutdown_connections 2021-01-27T09:24:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/1962210385 wait complete. 2021-01-27T09:24:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 Processor -- start 2021-01-27T09:24:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- start start 2021-01-27T09:24:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb35005f810 0x7fb35010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3500f9290 0x7fb35010d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:35.578 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35010d7e0 con 0x7fb35005f810 2021-01-27T09:24:35.578 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35010d950 con 0x7fb3500f9290 2021-01-27T09:24:35.578 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35010db10 con 0x7fb3500f67e0 2021-01-27T09:24:35.578 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35616b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb35005f810 0x7fb35010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:35.578 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.47:34866/0 (socket says 172.21.15.47:34866) 2021-01-27T09:24:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 -- 172.21.15.47:0/3995837113 learned_addr learned my addr 172.21.15.47:0/3995837113 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:24:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35696c700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3500f9290 0x7fb35010d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 -- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3500f9290 msgr2=0x7fb35010d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3500f9290 0x7fb35010d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 -- 172.21.15.47:0/3995837113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb35005f810 msgr2=0x7fb35010bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb35005f810 0x7fb35010bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 -- 172.21.15.47:0/3995837113 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35010dcd0 con 0x7fb3500f67e0 2021-01-27T09:24:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35596a700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb34c00b740 tx=0x7fb34c004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00e070 con 0x7fb3500f67e0 2021-01-27T09:24:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb34c004500 con 0x7fb3500f67e0 2021-01-27T09:24:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/3995837113 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35010df20 con 0x7fb3500f67e0 2021-01-27T09:24:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c018070 con 0x7fb3500f67e0 2021-01-27T09:24:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.577+0000 7fb35716d700 1 -- 172.21.15.47:0/3995837113 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3501146c0 con 0x7fb3500f67e0 2021-01-27T09:24:35.582 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.581+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c004da0 con 0x7fb3500f67e0 2021-01-27T09:24:35.582 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.581+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fb34c036a40 con 0x7fb3500f67e0 2021-01-27T09:24:35.583 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.581+0000 7fb346ffd700 1 --2- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 0x7fb33c05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:35.583 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.581+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4397+0+0 (secure 0 0 0) 0x7fb34c076e00 con 0x7fb3500f67e0 2021-01-27T09:24:35.583 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.581+0000 7fb35616b700 1 --2- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 0x7fb33c05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:35.583 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.585+0000 7fb35616b700 1 --2- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 0x7fb33c05e0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb340004c40 tx=0x7fb34000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:35.590 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.593+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb34c04a0d0 con 0x7fb3500f67e0 2021-01-27T09:24:35.755 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:35.757+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7fb32c005740 con 0x7fb3500f67e0 2021-01-27T09:24:36.268 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.268+0000 7fb346ffd700 1 -- 172.21.15.47:0/3995837113 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'iscsi' created v50) v1 ==== 154+0+0 (secure 0 0 0) 0x7fb34c04d6f0 con 0x7fb3500f67e0 2021-01-27T09:24:36.271 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 msgr2=0x7fb33c05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:36.271 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 0x7fb33c05e0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb340004c40 tx=0x7fb34000b040).stop 2021-01-27T09:24:36.271 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 msgr2=0x7fb35010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:36.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb34c00b740 tx=0x7fb34c004d10).stop 2021-01-27T09:24:36.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 shutdown_connections 2021-01-27T09:24:36.272 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> v2:172.21.15.103:6800/3303543367 conn(0x7fb33c05bc30 0x7fb33c05e0f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:36.273 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3500f9290 0x7fb35010d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:36.273 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb35005f810 0x7fb35010bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:36.273 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 --2- 172.21.15.47:0/3995837113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3500f67e0 0x7fb35010c3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:36.273 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 >> 172.21.15.47:0/3995837113 conn(0x7fb3500eff70 msgr2=0x7fb3500f4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:36.274 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 shutdown_connections 2021-01-27T09:24:36.274 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:36.272+0000 7fb344ff9700 1 -- 172.21.15.47:0/3995837113 wait complete. 2021-01-27T09:24:36.274 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'iscsi' created 2021-01-27T09:24:36.390 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:36 smithi103 bash[9772]: audit 2021-01-27T09:24:34.823542+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:36.391 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:36 smithi103 bash[9772]: audit 2021-01-27T09:24:34.825965+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:36.391 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:36 smithi103 bash[13570]: audit 2021-01-27T09:24:34.823542+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:36.392 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:36 smithi103 bash[13570]: audit 2021-01-27T09:24:34.825965+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:36.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:36 smithi047 bash[9721]: audit 2021-01-27T09:24:34.823542+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:36.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:36 smithi047 bash[9721]: audit 2021-01-27T09:24:34.825965+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:37.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-01-27T09:24:37.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:35.760227+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.47:0/3995837113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:35.760693+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: cluster 2021-01-27T09:24:36.207355+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 767 B/s wr, 1 op/s; 35 B/s, 0 objects/s recovering 2021-01-27T09:24:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:36.220564+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:36.227162+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:36.237504+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: audit 2021-01-27T09:24:36.271106+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T09:24:37.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:37 smithi047 bash[9721]: cluster 2021-01-27T09:24:36.271300+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T09:24:37.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:35.760227+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.47:0/3995837113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:35.760693+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: cluster 2021-01-27T09:24:36.207355+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 767 B/s wr, 1 op/s; 35 B/s, 0 objects/s recovering 2021-01-27T09:24:37.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:36.220564+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:36.227162+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:36.237504+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: audit 2021-01-27T09:24:36.271106+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T09:24:37.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[9772]: cluster 2021-01-27T09:24:36.271300+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T09:24:37.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:35.760227+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.47:0/3995837113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:35.760693+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T09:24:37.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: cluster 2021-01-27T09:24:36.207355+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 767 B/s wr, 1 op/s; 35 B/s, 0 objects/s recovering 2021-01-27T09:24:37.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:36.220564+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:36.227162+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:36.237504+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:37.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: audit 2021-01-27T09:24:36.271106+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T09:24:37.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:37 smithi103 bash[13570]: cluster 2021-01-27T09:24:36.271300+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T09:24:38.507 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: cephadm 2021-01-27T09:24:36.228422+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.508 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: cephadm 2021-01-27T09:24:36.229091+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.508 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: cephadm 2021-01-27T09:24:36.238702+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.508 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: cephadm 2021-01-27T09:24:36.239327+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.508 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: cluster 2021-01-27T09:24:37.270437+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T09:24:38.509 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:38 smithi047 bash[9721]: audit 2021-01-27T09:24:37.275953+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T09:24:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: cephadm 2021-01-27T09:24:36.228422+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: cephadm 2021-01-27T09:24:36.229091+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: cephadm 2021-01-27T09:24:36.238702+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: cephadm 2021-01-27T09:24:36.239327+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: cluster 2021-01-27T09:24:37.270437+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T09:24:38.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[13570]: audit 2021-01-27T09:24:37.275953+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T09:24:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: cephadm 2021-01-27T09:24:36.228422+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: cephadm 2021-01-27T09:24:36.229091+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: cephadm 2021-01-27T09:24:36.238702+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: cephadm 2021-01-27T09:24:36.239327+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: cluster 2021-01-27T09:24:37.270437+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T09:24:38.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:38 smithi103 bash[9772]: audit 2021-01-27T09:24:37.275953+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T09:24:39.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:39 smithi047 bash[9721]: cluster 2021-01-27T09:24:38.208218+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 3 creating+peering, 32 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2021-01-27T09:24:39.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:39 smithi047 bash[9721]: audit 2021-01-27T09:24:38.278852+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T09:24:39.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:39 smithi047 bash[9721]: cluster 2021-01-27T09:24:38.279255+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T09:24:39.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[9772]: cluster 2021-01-27T09:24:38.208218+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 3 creating+peering, 32 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2021-01-27T09:24:39.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[9772]: audit 2021-01-27T09:24:38.278852+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T09:24:39.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[9772]: cluster 2021-01-27T09:24:38.279255+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T09:24:39.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[13570]: cluster 2021-01-27T09:24:38.208218+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 3 creating+peering, 32 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2021-01-27T09:24:39.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[13570]: audit 2021-01-27T09:24:38.278852+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T09:24:39.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:39 smithi103 bash[13570]: cluster 2021-01-27T09:24:38.279255+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T09:24:40.521 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 -- 172.21.15.47:0/2624768354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 msgr2=0x7f67840f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:40.521 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 --2- 172.21.15.47:0/2624768354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f67840f5ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6778004e00 tx=0x7f6778009b30).stop 2021-01-27T09:24:40.522 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 -- 172.21.15.47:0/2624768354 shutdown_connections 2021-01-27T09:24:40.522 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 --2- 172.21.15.47:0/2624768354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f6390 0x7f67840fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:40.522 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 --2- 172.21.15.47:0/2624768354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f47a0 0x7f67840f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:40.522 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 --2- 172.21.15.47:0/2624768354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f67840f5ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:40.523 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 -- 172.21.15.47:0/2624768354 >> 172.21.15.47:0/2624768354 conn(0x7f67840effa0 msgr2=0x7f67840f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:40.523 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.520+0000 7f678359e700 1 -- 172.21.15.47:0/2624768354 shutdown_connections 2021-01-27T09:24:40.523 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- 172.21.15.47:0/2624768354 wait complete. 2021-01-27T09:24:40.524 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 Processor -- start 2021-01-27T09:24:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- start start 2021-01-27T09:24:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f47a0 0x7f6784108740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f6390 0x7f678410d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678410d630 con 0x7f67840f5a40 2021-01-27T09:24:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678410d770 con 0x7f67840f6390 2021-01-27T09:24:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678410d930 con 0x7f67840f47a0 2021-01-27T09:24:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38110/0 (socket says 172.21.15.47:38110) 2021-01-27T09:24:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 -- 172.21.15.47:0/3220878633 learned_addr learned my addr 172.21.15.47:0/3220878633 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:24:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678259c700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f47a0 0x7f6784108740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6782d9d700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f6390 0x7f678410d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 -- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f47a0 msgr2=0x7f6784108740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f47a0 0x7f6784108740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:40.528 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 -- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f6390 msgr2=0x7f678410d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:40.528 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f6390 0x7f678410d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:40.528 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 -- 172.21.15.47:0/3220878633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784104520 con 0x7f67840f5a40 2021-01-27T09:24:40.528 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6781d9b700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f67780043d0 tx=0x7f6778009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:40.528 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800e030 con 0x7f67840f5a40 2021-01-27T09:24:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6784104770 con 0x7f67840f5a40 2021-01-27T09:24:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f67780095c0 con 0x7f67840f5a40 2021-01-27T09:24:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778018070 con 0x7f67840f5a40 2021-01-27T09:24:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.524+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6784104c80 con 0x7f67840f5a40 2021-01-27T09:24:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67840f3b90 con 0x7f67840f5a40 2021-01-27T09:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f677801d420 con 0x7f67840f5a40 2021-01-27T09:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f6772ffd700 1 --2- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 0x7f676c05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5469+0+0 (secure 0 0 0) 0x7f6778077290 con 0x7f67840f5a40 2021-01-27T09:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f678259c700 1 --2- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 0x7f676c05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.528+0000 7f678259c700 1 --2- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 0x7f676c05e0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f678405f580 tx=0x7f677400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:40.532 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.532+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f677804a150 con 0x7f67840f5a40 2021-01-27T09:24:40.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:40 smithi047 bash[9721]: cluster 2021-01-27T09:24:39.286001+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T09:24:40.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:40 smithi047 bash[9721]: audit 2021-01-27T09:24:39.292897+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T09:24:40.546 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:40 smithi047 bash[9721]: cluster 2021-01-27T09:24:40.209386+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 5 creating+activating, 15 creating+peering, 20 unknown, 60 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-01-27T09:24:40.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[9772]: cluster 2021-01-27T09:24:39.286001+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T09:24:40.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[9772]: audit 2021-01-27T09:24:39.292897+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T09:24:40.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[9772]: cluster 2021-01-27T09:24:40.209386+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 5 creating+activating, 15 creating+peering, 20 unknown, 60 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-01-27T09:24:40.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[13570]: cluster 2021-01-27T09:24:39.286001+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T09:24:40.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[13570]: audit 2021-01-27T09:24:39.292897+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T09:24:40.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:40 smithi103 bash[13570]: cluster 2021-01-27T09:24:40.209386+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 5 creating+activating, 15 creating+peering, 20 unknown, 60 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-01-27T09:24:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:40.716+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"} v 0) v1 -- 0x7f67840ff520 con 0x7f67840f5a40 2021-01-27T09:24:41.754 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.751+0000 7f6772ffd700 1 -- 172.21.15.47:0/3220878633 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]=0 enabled application 'rbd' on pool 'iscsi' v55) v1 ==== 147+0+0 (secure 0 0 0) 0x7f677804d770 con 0x7f67840f5a40 2021-01-27T09:24:41.760 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 msgr2=0x7f676c05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:41.760 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 0x7f676c05e0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f678405f580 tx=0x7f677400b040).stop 2021-01-27T09:24:41.761 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 msgr2=0x7f678410ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:41.761 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f67780043d0 tx=0x7f6778009b30).stop 2021-01-27T09:24:41.762 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 shutdown_connections 2021-01-27T09:24:41.763 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> v2:172.21.15.103:6800/3303543367 conn(0x7f676c05bc30 0x7f676c05e0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:41.763 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67840f6390 0x7f678410d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:41.763 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f67840f47a0 0x7f6784108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:41.763 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 --2- 172.21.15.47:0/3220878633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67840f5a40 0x7f678410ac40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:41.764 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.759+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 >> 172.21.15.47:0/3220878633 conn(0x7f67840effa0 msgr2=0x7f67840f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:41.764 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.763+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 shutdown_connections 2021-01-27T09:24:41.764 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:41.763+0000 7f678359e700 1 -- 172.21.15.47:0/3220878633 wait complete. 2021-01-27T09:24:41.766 INFO:teuthology.orchestra.run.smithi047.stderr:enabled application 'rbd' on pool 'iscsi' 2021-01-27T09:24:42.046 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:41 smithi047 bash[9721]: audit 2021-01-27T09:24:40.294590+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T09:24:42.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:41 smithi047 bash[9721]: cluster 2021-01-27T09:24:40.294800+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T09:24:42.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:41 smithi047 bash[9721]: audit 2021-01-27T09:24:40.719728+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:41 smithi047 bash[9721]: audit 2021-01-27T09:24:40.721046+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.47:0/3220878633' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[9772]: audit 2021-01-27T09:24:40.294590+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T09:24:42.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[9772]: cluster 2021-01-27T09:24:40.294800+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T09:24:42.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[9772]: audit 2021-01-27T09:24:40.719728+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[9772]: audit 2021-01-27T09:24:40.721046+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.47:0/3220878633' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[13570]: audit 2021-01-27T09:24:40.294590+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.15.103:0/2926718436' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T09:24:42.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[13570]: cluster 2021-01-27T09:24:40.294800+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T09:24:42.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[13570]: audit 2021-01-27T09:24:40.719728+0000 mon.a (mon.0) 558 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:41 smithi103 bash[13570]: audit 2021-01-27T09:24:40.721046+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.47:0/3220878633' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T09:24:42.597 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi047=iscsi.a' 2021-01-27T09:24:43.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:42 smithi047 bash[9721]: audit 2021-01-27T09:24:41.755317+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T09:24:43.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:42 smithi047 bash[9721]: cluster 2021-01-27T09:24:41.755578+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T09:24:43.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:42 smithi047 bash[9721]: audit 2021-01-27T09:24:41.763339+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:42 smithi047 bash[9721]: audit 2021-01-27T09:24:41.764217+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:42 smithi047 bash[9721]: cluster 2021-01-27T09:24:42.210098+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+activating, 15 creating+peering, 48 unknown, 64 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T09:24:43.141 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[9772]: audit 2021-01-27T09:24:41.755317+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T09:24:43.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[9772]: cluster 2021-01-27T09:24:41.755578+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T09:24:43.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[9772]: audit 2021-01-27T09:24:41.763339+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[9772]: audit 2021-01-27T09:24:41.764217+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[9772]: cluster 2021-01-27T09:24:42.210098+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+activating, 15 creating+peering, 48 unknown, 64 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T09:24:43.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[13570]: audit 2021-01-27T09:24:41.755317+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T09:24:43.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[13570]: cluster 2021-01-27T09:24:41.755578+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T09:24:43.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[13570]: audit 2021-01-27T09:24:41.763339+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[13570]: audit 2021-01-27T09:24:41.764217+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T09:24:43.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:42 smithi103 bash[13570]: cluster 2021-01-27T09:24:42.210098+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+activating, 15 creating+peering, 48 unknown, 64 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T09:24:44.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:42.763229+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T09:24:44.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: cluster 2021-01-27T09:24:42.763603+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T09:24:44.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:42.766710+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:42.768376+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:43.761947+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T09:24:44.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: cluster 2021-01-27T09:24:43.762176+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T09:24:44.048 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:43.763214+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:44.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:43 smithi047 bash[9721]: audit 2021-01-27T09:24:43.763878+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:44.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:42.763229+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T09:24:44.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: cluster 2021-01-27T09:24:42.763603+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T09:24:44.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:42.766710+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:42.768376+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:43.761947+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T09:24:44.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: cluster 2021-01-27T09:24:43.762176+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T09:24:44.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:43.763214+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:44.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[9772]: audit 2021-01-27T09:24:43.763878+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:44.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:42.763229+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T09:24:44.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: cluster 2021-01-27T09:24:42.763603+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T09:24:44.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:42.766710+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:42.768376+0000 mon.a (mon.0) 564 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T09:24:44.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:43.761947+0000 mon.a (mon.0) 565 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T09:24:44.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: cluster 2021-01-27T09:24:43.762176+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T09:24:44.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:43.763214+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.103:0/798509824' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:44.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:43 smithi103 bash[13570]: audit 2021-01-27T09:24:43.763878+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T09:24:45.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:44 smithi047 bash[9721]: cluster 2021-01-27T09:24:44.210829+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 12 creating+peering, 21 unknown, 99 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 KiB/s wr, 43 op/s 2021-01-27T09:24:45.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:44 smithi047 bash[9721]: audit 2021-01-27T09:24:44.763899+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T09:24:45.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:44 smithi047 bash[9721]: cluster 2021-01-27T09:24:44.764091+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T09:24:45.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[13570]: cluster 2021-01-27T09:24:44.210829+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 12 creating+peering, 21 unknown, 99 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 KiB/s wr, 43 op/s 2021-01-27T09:24:45.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[13570]: audit 2021-01-27T09:24:44.763899+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T09:24:45.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[13570]: cluster 2021-01-27T09:24:44.764091+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T09:24:45.142 INFO:journalctl@ceph.rgw.realm.zone.a.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[25171]: debug 2021-01-27T09:24:44.910+0000 7f671ab7e2c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2021-01-27T09:24:45.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[9772]: cluster 2021-01-27T09:24:44.210829+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 12 creating+peering, 21 unknown, 99 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 KiB/s wr, 43 op/s 2021-01-27T09:24:45.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[9772]: audit 2021-01-27T09:24:44.763899+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T09:24:45.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:44 smithi103 bash[9772]: cluster 2021-01-27T09:24:44.764091+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T09:24:46.439 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- 172.21.15.47:0/413271883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44069420 msgr2=0x7f7d440698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:46.439 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- 172.21.15.47:0/413271883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44069420 0x7f7d440698a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7d2c004e00 tx=0x7f7d2c009b30).stop 2021-01-27T09:24:46.439 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- 172.21.15.47:0/413271883 shutdown_connections 2021-01-27T09:24:46.439 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- 172.21.15.47:0/413271883 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d440fd850 0x7f7d440ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.440 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- 172.21.15.47:0/413271883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d4406aa30 0x7f7d44068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.440 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- 172.21.15.47:0/413271883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44069420 0x7f7d440698a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.440 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- 172.21.15.47:0/413271883 >> 172.21.15.47:0/413271883 conn(0x7f7d440f10a0 msgr2=0x7f7d440f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:46.440 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- 172.21.15.47:0/413271883 shutdown_connections 2021-01-27T09:24:46.440 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- 172.21.15.47:0/413271883 wait complete. 2021-01-27T09:24:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 Processor -- start 2021-01-27T09:24:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- start start 2021-01-27T09:24:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d4406aa30 0x7f7d44107eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d440fd850 0x7f7d441083a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44109b00 con 0x7f7d44109150 2021-01-27T09:24:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44109c70 con 0x7f7d440fd850 2021-01-27T09:24:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d49540700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44109e30 con 0x7f7d4406aa30 2021-01-27T09:24:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38126/0 (socket says 172.21.15.47:38126) 2021-01-27T09:24:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 -- 172.21.15.47:0/3811206121 learned_addr learned my addr 172.21.15.47:0/3811206121 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:24:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d43fff700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d4406aa30 0x7f7d44107eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d437fe700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d440fd850 0x7f7d441083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 -- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d4406aa30 msgr2=0x7f7d44107eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d4406aa30 0x7f7d44107eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 -- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d440fd850 msgr2=0x7f7d441083a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d440fd850 0x7f7d441083a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 -- 172.21.15.47:0/3811206121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d441103a0 con 0x7f7d44109150 2021-01-27T09:24:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d48d3f700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7d3c00ed60 tx=0x7f7d3c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00eec0 con 0x7f7d44109150 2021-01-27T09:24:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7d3c00f040 con 0x7f7d44109150 2021-01-27T09:24:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.443+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c007620 con 0x7f7d44109150 2021-01-27T09:24:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44110530 con 0x7f7d44109150 2021-01-27T09:24:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44110940 con 0x7f7d44109150 2021-01-27T09:24:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d440f4c90 con 0x7f7d44109150 2021-01-27T09:24:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f7d3c004020 con 0x7f7d44109150 2021-01-27T09:24:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d40ff9700 1 --2- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 0x7f7d3005e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5875+0+0 (secure 0 0 0) 0x7f7d3c075960 con 0x7f7d44109150 2021-01-27T09:24:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.447+0000 7f7d43fff700 1 --2- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 0x7f7d3005e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.451+0000 7f7d43fff700 1 --2- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 0x7f7d3005e0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7d34009fd0 tx=0x7f7d3400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:46.453 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.455+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f7d3c0468c0 con 0x7f7d44109150 2021-01-27T09:24:46.547 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:46 smithi047 bash[9721]: cluster 2021-01-27T09:24:46.211880+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v222: 132 pgs: 6 unknown, 126 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 29 KiB/s wr, 114 op/s 2021-01-27T09:24:46.641 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:46 smithi103 bash[13570]: cluster 2021-01-27T09:24:46.211880+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v222: 132 pgs: 6 unknown, 126 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 29 KiB/s wr, 114 op/s 2021-01-27T09:24:46.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:46 smithi103 bash[9772]: cluster 2021-01-27T09:24:46.211880+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v222: 132 pgs: 6 unknown, 126 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 29 KiB/s wr, 114 op/s 2021-01-27T09:24:46.652 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.655+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi047=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d440f33c0 con 0x7f7d3005bc30 2021-01-27T09:24:46.664 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.667+0000 7f7d40ff9700 1 -- 172.21.15.47:0/3811206121 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7d440f33c0 con 0x7f7d3005bc30 2021-01-27T09:24:46.664 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled iscsi.iscsi update... 2021-01-27T09:24:46.666 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 msgr2=0x7f7d3005e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:46.666 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 0x7f7d3005e0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7d34009fd0 tx=0x7f7d3400b040).stop 2021-01-27T09:24:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 msgr2=0x7f7d441095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7d3c00ed60 tx=0x7f7d3c00b040).stop 2021-01-27T09:24:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 shutdown_connections 2021-01-27T09:24:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7d3005bc30 0x7f7d3005e0f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d44109150 0x7f7d441095d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7d4406aa30 0x7f7d44107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 --2- 172.21.15.47:0/3811206121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d440fd850 0x7f7d441083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 >> 172.21.15.47:0/3811206121 conn(0x7f7d440f10a0 msgr2=0x7f7d440f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 shutdown_connections 2021-01-27T09:24:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:46.671+0000 7f7d49540700 1 -- 172.21.15.47:0/3811206121 wait complete. 2021-01-27T09:24:47.936 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.657540+0000 mgr.y (mgr.14138) 257 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi047=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:47.937 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.659986+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:47.937 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.665735+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:47.937 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.675053+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:47.937 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.676762+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:47.938 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.677676+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:47.938 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.678694+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] 2021-01-27T09:24:47.938 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.679114+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T09:24:47.938 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.689354+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:47.939 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.693873+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:47.939 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.695286+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T09:24:47.939 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.700697+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T09:24:47.939 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.715528+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:47.939 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: cephadm 2021-01-27T09:24:46.716758+0000 mgr.y (mgr.14138) 264 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi047 2021-01-27T09:24:47.940 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:47 smithi047 bash[9721]: audit 2021-01-27T09:24:46.717778+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:47.940 DEBUG:teuthology.orchestra.run.smithi047:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@iscsi.iscsi.a.service 2021-01-27T09:24:47.943 INFO:tasks.cephadm:Adding prometheus.a on smithi047 2021-01-27T09:24:47.943 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply prometheus '1;smithi047=a' 2021-01-27T09:24:48.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:24:48.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.657540+0000 mgr.y (mgr.14138) 257 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi047=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:48.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.659986+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:48.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.665735+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.675053+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.676762+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:48.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.677676+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.678694+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] 2021-01-27T09:24:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.679114+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T09:24:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.689354+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.693873+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.695286+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T09:24:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.700697+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T09:24:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.715528+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: cephadm 2021-01-27T09:24:46.716758+0000 mgr.y (mgr.14138) 264 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi047 2021-01-27T09:24:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[9772]: audit 2021-01-27T09:24:46.717778+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:48.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.657540+0000 mgr.y (mgr.14138) 257 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi047=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:48.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.659986+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:48.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.665735+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.675053+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.676762+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.677676+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.678694+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] 2021-01-27T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.679114+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.689354+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi047=iscsi.a;count:1 2021-01-27T09:24:48.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.693873+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.695286+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T09:24:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.700697+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T09:24:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.715528+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T09:24:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: cephadm 2021-01-27T09:24:46.716758+0000 mgr.y (mgr.14138) 264 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi047 2021-01-27T09:24:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:47 smithi103 bash[13570]: audit 2021-01-27T09:24:46.717778+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T09:24:49.047 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:48 smithi047 bash[9721]: cluster 2021-01-27T09:24:48.212955+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 22 KiB/s wr, 104 op/s 2021-01-27T09:24:49.142 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:48 smithi103 bash[9772]: cluster 2021-01-27T09:24:48.212955+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 22 KiB/s wr, 104 op/s 2021-01-27T09:24:49.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:48 smithi103 bash[13570]: cluster 2021-01-27T09:24:48.212955+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 22 KiB/s wr, 104 op/s 2021-01-27T09:24:50.601 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:50 smithi047 bash[9721]: cluster 2021-01-27T09:24:49.322968+0000 mon.a (mon.0) 577 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T09:24:50.601 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:50 smithi047 bash[9721]: cluster 2021-01-27T09:24:50.214526+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 21 KiB/s wr, 216 op/s 2021-01-27T09:24:50.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:50 smithi103 bash[9772]: cluster 2021-01-27T09:24:49.322968+0000 mon.a (mon.0) 577 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T09:24:50.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:50 smithi103 bash[9772]: cluster 2021-01-27T09:24:50.214526+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 21 KiB/s wr, 216 op/s 2021-01-27T09:24:50.642 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:50 smithi103 bash[13570]: cluster 2021-01-27T09:24:49.322968+0000 mon.a (mon.0) 577 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T09:24:50.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:50 smithi103 bash[13570]: cluster 2021-01-27T09:24:50.214526+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 21 KiB/s wr, 216 op/s 2021-01-27T09:24:51.436 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:51 smithi047 systemd[1]: Started Ceph iscsi.iscsi.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:24:52.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:52 smithi047 bash[9721]: audit 2021-01-27T09:24:51.319714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:52.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:52 smithi047 bash[9721]: cephadm 2021-01-27T09:24:51.321996+0000 mgr.y (mgr.14138) 267 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:24:52.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:52 smithi047 bash[9721]: audit 2021-01-27T09:24:51.323182+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:52.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:52 smithi047 bash[9721]: cluster 2021-01-27T09:24:52.215450+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 14 KiB/s wr, 170 op/s 2021-01-27T09:24:52.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[9772]: audit 2021-01-27T09:24:51.319714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:52.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[9772]: cephadm 2021-01-27T09:24:51.321996+0000 mgr.y (mgr.14138) 267 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:24:52.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[9772]: audit 2021-01-27T09:24:51.323182+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:52.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[9772]: cluster 2021-01-27T09:24:52.215450+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 14 KiB/s wr, 170 op/s 2021-01-27T09:24:52.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[13570]: audit 2021-01-27T09:24:51.319714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:52.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[13570]: cephadm 2021-01-27T09:24:51.321996+0000 mgr.y (mgr.14138) 267 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:24:52.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[13570]: audit 2021-01-27T09:24:51.323182+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:24:52.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:52 smithi103 bash[13570]: cluster 2021-01-27T09:24:52.215450+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 14 KiB/s wr, 170 op/s 2021-01-27T09:24:53.948 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- 172.21.15.47:0/88486074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f7880 msgr2=0x7f432c0f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:53.949 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- 172.21.15.47:0/88486074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f7880 0x7f432c0f3a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4320004e00 tx=0x7f4320009b30).stop 2021-01-27T09:24:53.949 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- 172.21.15.47:0/88486074 shutdown_connections 2021-01-27T09:24:53.949 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- 172.21.15.47:0/88486074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 0x7f432c0f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:53.949 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- 172.21.15.47:0/88486074 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f6ee0 0x7f432c0f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:53.950 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- 172.21.15.47:0/88486074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f7880 0x7f432c0f3a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:53.950 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- 172.21.15.47:0/88486074 >> 172.21.15.47:0/88486074 conn(0x7f432c0ef740 msgr2=0x7f432c0f1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:53.950 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- 172.21.15.47:0/88486074 shutdown_connections 2021-01-27T09:24:53.950 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- 172.21.15.47:0/88486074 wait complete. 2021-01-27T09:24:53.952 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 Processor -- start 2021-01-27T09:24:53.952 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- start start 2021-01-27T09:24:53.952 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 0x7f432c105930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 0x7f432c106d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c107240 con 0x7f432c0f6ee0 2021-01-27T09:24:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1073b0 con 0x7f432c0f3fd0 2021-01-27T09:24:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432bfff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c107570 con 0x7f432c0f7880 2021-01-27T09:24:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38180/0 (socket says 172.21.15.47:38180) 2021-01-27T09:24:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 -- 172.21.15.47:0/2025792009 learned_addr learned my addr 172.21.15.47:0/2025792009 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:24:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432affd700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 0x7f432c105930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432b7fe700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 0x7f432c106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 -- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 msgr2=0x7f432c106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 0x7f432c106d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 -- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 msgr2=0x7f432c105930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 0x7f432c105930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:53.955 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 -- 172.21.15.47:0/2025792009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c107730 con 0x7f432c0f6ee0 2021-01-27T09:24:53.956 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432b7fe700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 0x7f432c106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:24:53.956 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.950+0000 7f432a7fc700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4320009c20 tx=0x7f4320009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:53.956 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000e030 con 0x7f432c0f6ee0 2021-01-27T09:24:53.956 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f432001d880 con 0x7f432c0f6ee0 2021-01-27T09:24:53.957 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320018070 con 0x7f432c0f6ee0 2021-01-27T09:24:53.957 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c107980 con 0x7f432c0f6ee0 2021-01-27T09:24:53.957 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c10e120 con 0x7f432c0f6ee0 2021-01-27T09:24:53.958 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c0f3310 con 0x7f432c0f6ee0 2021-01-27T09:24:53.958 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f432001d420 con 0x7f432c0f6ee0 2021-01-27T09:24:53.958 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 --2- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 0x7f431405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:24:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5875+0+0 (secure 0 0 0) 0x7f4320077600 con 0x7f432c0f6ee0 2021-01-27T09:24:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.954+0000 7f432affd700 1 --2- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 0x7f431405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:24:53.959 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.958+0000 7f432affd700 1 --2- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 0x7f431405e130 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f431c009fd0 tx=0x7f431c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:24:53.962 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:53.962+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f432004a360 con 0x7f432c0f6ee0 2021-01-27T09:24:53.991 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.727905+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:53.991 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.737401+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:53.992 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.738731+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:53.992 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.739557+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:53.992 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.740335+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:53.992 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.746822+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:53.993 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.748161+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:53.993 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.751960+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.47:5000 to Dashboard 2021-01-27T09:24:53.993 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.752397+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:53.993 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.752955+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:53.993 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.762285+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:53.994 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.766281+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:53.994 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.767335+0000 mgr.y (mgr.14138) 275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:53.994 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.783318+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:53.994 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: audit 2021-01-27T09:24:52.793793+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:53.994 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.795412+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:53.995 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.796379+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:53.995 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[9721]: cephadm 2021-01-27T09:24:52.797273+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:53.995 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[21993]: log file path now is '/var/log/tcmu-runner.log' 2021-01-27T09:24:53.995 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[22021]: debug Started the configuration object watcher 2021-01-27T09:24:53.995 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[22021]: debug Checking for config object changes every 1s 2021-01-27T09:24:53.996 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:53 smithi047 bash[22021]: debug Processing osd blocklist entries for this node 2021-01-27T09:24:54.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.727905+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.737401+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.738731+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:54.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.739557+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:54.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.740335+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:54.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.746822+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:54.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.748161+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:54.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.751960+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.47:5000 to Dashboard 2021-01-27T09:24:54.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.752397+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:54.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.752955+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:54.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.762285+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.766281+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:54.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.767335+0000 mgr.y (mgr.14138) 275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:54.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.783318+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: audit 2021-01-27T09:24:52.793793+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.795412+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:54.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.796379+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:54.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[9772]: cephadm 2021-01-27T09:24:52.797273+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:54.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.727905+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.737401+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.738731+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:54.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.739557+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:54.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.740335+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:54.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.746822+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:54.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.748161+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T09:24:54.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.751960+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.47:5000 to Dashboard 2021-01-27T09:24:54.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.752397+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:54.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.752955+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T09:24:54.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.762285+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.766281+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:54.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.767335+0000 mgr.y (mgr.14138) 275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi047"}]: dispatch 2021-01-27T09:24:54.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.783318+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: audit 2021-01-27T09:24:52.793793+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:54.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.795412+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:54.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.796379+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:54.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:53 smithi103 bash[13570]: cephadm 2021-01-27T09:24:52.797273+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:54.162 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.162+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f432c100610 con 0x7f431405bc70 2021-01-27T09:24:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.174+0000 7f43137fe700 1 -- 172.21.15.47:0/2025792009 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f432c100610 con 0x7f431405bc70 2021-01-27T09:24:54.175 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled prometheus update... 2021-01-27T09:24:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 msgr2=0x7f431405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 0x7f431405e130 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f431c009fd0 tx=0x7f431c00b040).stop 2021-01-27T09:24:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 msgr2=0x7f432c105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:24:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4320009c20 tx=0x7f4320009b30).stop 2021-01-27T09:24:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 shutdown_connections 2021-01-27T09:24:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> v2:172.21.15.103:6800/3303543367 conn(0x7f431405bc70 0x7f431405e130 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432c0f7880 0x7f432c106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432c0f3fd0 0x7f432c105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 --2- 172.21.15.47:0/2025792009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f432c0f6ee0 0x7f432c105e20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:24:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 >> 172.21.15.47:0/2025792009 conn(0x7f432c0ef740 msgr2=0x7f432c0f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:24:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 shutdown_connections 2021-01-27T09:24:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:24:54.178+0000 7f432bfff700 1 -- 172.21.15.47:0/2025792009 wait complete. 2021-01-27T09:24:54.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:54 smithi047 bash[22021]: debug Reading the configuration object to update local LIO configuration 2021-01-27T09:24:54.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:54 smithi047 bash[22021]: debug Configuration does not have an entry for this host(smithi047.front.sepia.ceph.com) - nothing to define to LIO 2021-01-27T09:24:54.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:24:54 smithi047 bash[22021]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-01-27T09:24:55.114 DEBUG:teuthology.orchestra.run.smithi047:prometheus.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@prometheus.a.service 2021-01-27T09:24:55.121 INFO:tasks.cephadm:Adding node-exporter.a on smithi103 2021-01-27T09:24:55.121 INFO:tasks.cephadm:Adding node-exporter.b on smithi047 2021-01-27T09:24:55.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply node-exporter '2;smithi103=a;smithi047=b' 2021-01-27T09:24:55.145 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:24:55.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: audit 2021-01-27T09:24:54.166537+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:55.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.168712+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Saving service prometheus spec with placement smithi047=a;count:1 2021-01-27T09:24:55.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: audit 2021-01-27T09:24:54.175676+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: audit 2021-01-27T09:24:54.185078+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.187024+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:55.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.188136+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:55.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.189210+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:55.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.190377+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:24:55.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cephadm 2021-01-27T09:24:54.201013+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Deploying daemon prometheus.a on smithi047 2021-01-27T09:24:55.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: audit 2021-01-27T09:24:54.205467+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.47:0/2857686758' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T09:24:55.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:55 smithi047 bash[9721]: cluster 2021-01-27T09:24:54.216804+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 12 KiB/s wr, 143 op/s 2021-01-27T09:24:55.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: audit 2021-01-27T09:24:54.166537+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:55.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.168712+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Saving service prometheus spec with placement smithi047=a;count:1 2021-01-27T09:24:55.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: audit 2021-01-27T09:24:54.175676+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: audit 2021-01-27T09:24:54.185078+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.187024+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.188136+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.189210+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.190377+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:24:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cephadm 2021-01-27T09:24:54.201013+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Deploying daemon prometheus.a on smithi047 2021-01-27T09:24:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: audit 2021-01-27T09:24:54.205467+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.47:0/2857686758' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T09:24:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[9772]: cluster 2021-01-27T09:24:54.216804+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 12 KiB/s wr, 143 op/s 2021-01-27T09:24:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: audit 2021-01-27T09:24:54.166537+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:24:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.168712+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Saving service prometheus spec with placement smithi047=a;count:1 2021-01-27T09:24:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: audit 2021-01-27T09:24:54.175676+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: audit 2021-01-27T09:24:54.185078+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:24:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.187024+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:24:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.188136+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:24:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.189210+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:24:55.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.190377+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:24:55.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cephadm 2021-01-27T09:24:54.201013+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Deploying daemon prometheus.a on smithi047 2021-01-27T09:24:55.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: audit 2021-01-27T09:24:54.205467+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.47:0/2857686758' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T09:24:55.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:55 smithi103 bash[13570]: cluster 2021-01-27T09:24:54.216804+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 12 KiB/s wr, 143 op/s 2021-01-27T09:24:56.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:56 smithi047 bash[9721]: cluster 2021-01-27T09:24:56.217929+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 4.6 KiB/s wr, 104 op/s 2021-01-27T09:24:56.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:56 smithi103 bash[9772]: cluster 2021-01-27T09:24:56.217929+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 4.6 KiB/s wr, 104 op/s 2021-01-27T09:24:56.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:56 smithi103 bash[13570]: cluster 2021-01-27T09:24:56.217929+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 4.6 KiB/s wr, 104 op/s 2021-01-27T09:24:58.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:58 smithi047 bash[9721]: audit 2021-01-27T09:24:58.148127+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-27T09:24:58.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:58 smithi047 bash[9721]: audit 2021-01-27T09:24:58.148639+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-01-27T09:24:58.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:58 smithi047 bash[9721]: audit 2021-01-27T09:24:58.149146+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-01-27T09:24:58.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:58 smithi047 bash[9721]: audit 2021-01-27T09:24:58.149574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-27T09:24:58.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[9772]: audit 2021-01-27T09:24:58.148127+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-27T09:24:58.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[9772]: audit 2021-01-27T09:24:58.148639+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-01-27T09:24:58.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[9772]: audit 2021-01-27T09:24:58.149146+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-01-27T09:24:58.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[9772]: audit 2021-01-27T09:24:58.149574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-27T09:24:58.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[13570]: audit 2021-01-27T09:24:58.148127+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-27T09:24:58.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[13570]: audit 2021-01-27T09:24:58.148639+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-01-27T09:24:58.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[13570]: audit 2021-01-27T09:24:58.149146+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-01-27T09:24:58.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:58 smithi103 bash[13570]: audit 2021-01-27T09:24:58.149574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-27T09:24:59.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.207865+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-27T09:24:59.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.208058+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-01-27T09:24:59.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.208195+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2021-01-27T09:24:59.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.208328+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-27T09:24:59.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: cluster 2021-01-27T09:24:58.208447+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T09:24:59.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: cluster 2021-01-27T09:24:58.218916+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 3.1 KiB/s wr, 99 op/s 2021-01-27T09:24:59.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.329787+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:24:59.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:24:59 smithi047 bash[9721]: audit 2021-01-27T09:24:58.333986+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:24:59.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.207865+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-27T09:24:59.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.208058+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-01-27T09:24:59.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.208195+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2021-01-27T09:24:59.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.208328+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-27T09:24:59.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: cluster 2021-01-27T09:24:58.208447+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T09:24:59.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: cluster 2021-01-27T09:24:58.218916+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 3.1 KiB/s wr, 99 op/s 2021-01-27T09:24:59.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.329787+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:24:59.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[9772]: audit 2021-01-27T09:24:58.333986+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:24:59.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.207865+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-27T09:24:59.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.208058+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2021-01-27T09:24:59.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.208195+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2021-01-27T09:24:59.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.208328+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-27T09:24:59.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: cluster 2021-01-27T09:24:58.208447+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T09:24:59.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: cluster 2021-01-27T09:24:58.218916+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 3.1 KiB/s wr, 99 op/s 2021-01-27T09:24:59.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.329787+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:24:59.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:24:59 smithi103 bash[13570]: audit 2021-01-27T09:24:58.333986+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:25:00.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:00 smithi047 bash[9721]: cluster 2021-01-27T09:24:59.235944+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T09:25:00.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:00 smithi047 bash[9721]: cluster 2021-01-27T09:25:00.220030+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v231: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:00 smithi103 bash[9772]: cluster 2021-01-27T09:24:59.235944+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T09:25:00.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:00 smithi103 bash[9772]: cluster 2021-01-27T09:25:00.220030+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v231: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:00.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:00 smithi103 bash[13570]: cluster 2021-01-27T09:24:59.235944+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T09:25:00.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:00 smithi103 bash[13570]: cluster 2021-01-27T09:25:00.220030+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v231: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:02.038 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- 172.21.15.47:0/3068479063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f6cc0 msgr2=0x7f32bc0f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:02.038 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3068479063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f6cc0 0x7f32bc0f7120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f32ac004e00 tx=0x7f32ac009b30).stop 2021-01-27T09:25:02.038 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- 172.21.15.47:0/3068479063 shutdown_connections 2021-01-27T09:25:02.038 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3068479063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f7610 0x7f32bc0fdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.039 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3068479063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f5a20 0x7f32bc0f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.039 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3068479063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f6cc0 0x7f32bc0f7120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.039 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- 172.21.15.47:0/3068479063 >> 172.21.15.47:0/3068479063 conn(0x7f32bc0f1220 msgr2=0x7f32bc0f3640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:02.039 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- 172.21.15.47:0/3068479063 shutdown_connections 2021-01-27T09:25:02.039 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- 172.21.15.47:0/3068479063 wait complete. 2021-01-27T09:25:02.041 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 Processor -- start 2021-01-27T09:25:02.041 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- start start 2021-01-27T09:25:02.041 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 0x7f32bc105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f7610 0x7f32bc10ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc10d3a0 con 0x7f32bc0f5a20 2021-01-27T09:25:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc10d4e0 con 0x7f32bc0f7610 2021-01-27T09:25:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.037+0000 7f32c3b33700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc10d620 con 0x7f32bc0f6cc0 2021-01-27T09:25:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38242/0 (socket says 172.21.15.47:38242) 2021-01-27T09:25:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 -- 172.21.15.47:0/3698441219 learned_addr learned my addr 172.21.15.47:0/3698441219 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:25:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c20d0700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f7610 0x7f32bc10ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:02.043 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c10ce700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 0x7f32bc105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 -- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 msgr2=0x7f32bc105dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 0x7f32bc105dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 -- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f7610 msgr2=0x7f32bc10ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f7610 0x7f32bc10ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 -- 172.21.15.47:0/3698441219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc10d7e0 con 0x7f32bc0f5a20 2021-01-27T09:25:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c10ce700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 0x7f32bc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:25:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c18cf700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f32b800eb90 tx=0x7f32b800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b80092e0 con 0x7f32bc0f5a20 2021-01-27T09:25:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f32b800f040 con 0x7f32bc0f5a20 2021-01-27T09:25:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800c910 con 0x7f32bc0f5a20 2021-01-27T09:25:02.046 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc10da90 con 0x7f32bc0f5a20 2021-01-27T09:25:02.046 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc10df80 con 0x7f32bc0f5a20 2021-01-27T09:25:02.047 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.041+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc05e700 con 0x7f32bc0f5a20 2021-01-27T09:25:02.047 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.045+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f32b801b030 con 0x7f32bc0f5a20 2021-01-27T09:25:02.048 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.045+0000 7f32b27fc700 1 --2- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 0x7f32a805e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:02.048 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.045+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f32b8075680 con 0x7f32bc0f5a20 2021-01-27T09:25:02.048 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.045+0000 7f32c10ce700 1 --2- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 0x7f32a805e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:02.048 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.045+0000 7f32c10ce700 1 --2- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 0x7f32a805e1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f32ac004dd0 tx=0x7f32ac009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:02.049 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.049+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f32bc05e700 con 0x7f32bc0f5a20 2021-01-27T09:25:02.266 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.265+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi103=a;smithi047=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f32bc1007a0 con 0x7f32a805bd20 2021-01-27T09:25:02.278 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.277+0000 7f32b27fc700 1 -- 172.21.15.47:0/3698441219 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f32bc1007a0 con 0x7f32a805bd20 2021-01-27T09:25:02.278 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled node-exporter update... 2021-01-27T09:25:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 msgr2=0x7f32a805e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 0x7f32a805e1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f32ac004dd0 tx=0x7f32ac009b30).stop 2021-01-27T09:25:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 msgr2=0x7f32bc1058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f32b800eb90 tx=0x7f32b800b040).stop 2021-01-27T09:25:02.281 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 shutdown_connections 2021-01-27T09:25:02.281 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> v2:172.21.15.103:6800/3303543367 conn(0x7f32a805bd20 0x7f32a805e1e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.281 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32bc0f7610 0x7f32bc10ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.282 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32bc0f5a20 0x7f32bc1058e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.282 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 --2- 172.21.15.47:0/3698441219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32bc0f6cc0 0x7f32bc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:02.282 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 >> 172.21.15.47:0/3698441219 conn(0x7f32bc0f1220 msgr2=0x7f32bc0f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:02.282 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 shutdown_connections 2021-01-27T09:25:02.283 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:02.281+0000 7f32c3b33700 1 -- 172.21.15.47:0/3698441219 wait complete. 2021-01-27T09:25:02.548 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:02 smithi047 bash[9721]: cluster 2021-01-27T09:25:02.220941+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v232: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:02.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:02 smithi103 bash[9772]: cluster 2021-01-27T09:25:02.220941+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v232: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:02.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:02 smithi103 bash[13570]: cluster 2021-01-27T09:25:02.220941+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v232: 132 pgs: 3 peering, 129 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s; 77 B/s, 1 objects/s recovering 2021-01-27T09:25:03.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:03 smithi047 bash[9721]: audit 2021-01-27T09:25:02.269912+0000 mgr.y (mgr.14138) 291 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi103=a;smithi047=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:03.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:03 smithi047 bash[9721]: cephadm 2021-01-27T09:25:02.272081+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Saving service node-exporter spec with placement smithi103=a;smithi047=b;count:2 2021-01-27T09:25:03.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:03 smithi047 bash[9721]: audit 2021-01-27T09:25:02.278673+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:03.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[9772]: audit 2021-01-27T09:25:02.269912+0000 mgr.y (mgr.14138) 291 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi103=a;smithi047=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:03.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[9772]: cephadm 2021-01-27T09:25:02.272081+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Saving service node-exporter spec with placement smithi103=a;smithi047=b;count:2 2021-01-27T09:25:03.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[9772]: audit 2021-01-27T09:25:02.278673+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[13570]: audit 2021-01-27T09:25:02.269912+0000 mgr.y (mgr.14138) 291 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi103=a;smithi047=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[13570]: cephadm 2021-01-27T09:25:02.272081+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Saving service node-exporter spec with placement smithi103=a;smithi047=b;count:2 2021-01-27T09:25:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[13570]: audit 2021-01-27T09:25:02.278673+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:03.698 DEBUG:teuthology.orchestra.run.smithi103:node-exporter.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@node-exporter.a.service 2021-01-27T09:25:03.702 DEBUG:teuthology.orchestra.run.smithi047:node-exporter.b> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@node-exporter.b.service 2021-01-27T09:25:03.706 INFO:tasks.cephadm:Adding alertmanager.a on smithi103 2021-01-27T09:25:03.706 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply alertmanager '1;smithi103=a' 2021-01-27T09:25:03.730 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:25:03.754 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:25:03.947 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:03 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:04.142 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:03 smithi103 bash[10018]: debug 2021-01-27T09:25:03.892+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:04.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:04 smithi103 bash[9772]: audit 2021-01-27T09:25:03.895543+0000 mgr.y (mgr.14138) 293 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:04.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:04 smithi103 bash[9772]: cluster 2021-01-27T09:25:04.222166+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:04.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:04 smithi103 bash[13570]: audit 2021-01-27T09:25:03.895543+0000 mgr.y (mgr.14138) 293 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:04.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:04 smithi103 bash[13570]: cluster 2021-01-27T09:25:04.222166+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:04.799 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:04 smithi047 bash[9721]: audit 2021-01-27T09:25:03.895543+0000 mgr.y (mgr.14138) 293 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:04.799 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:04 smithi047 bash[9721]: cluster 2021-01-27T09:25:04.222166+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:07.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:07 smithi047 bash[9721]: cluster 2021-01-27T09:25:06.223289+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:07.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:07 smithi103 bash[13570]: cluster 2021-01-27T09:25:06.223289+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:07.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:07 smithi103 bash[9772]: cluster 2021-01-27T09:25:06.223289+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 170 B/s, 3 objects/s recovering 2021-01-27T09:25:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- 172.21.15.47:0/1350274484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40f8b90 msgr2=0x7f46c40fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 --2- 172.21.15.47:0/1350274484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40f8b90 0x7f46c40fafe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f46ac004e00 tx=0x7f46ac009b30).stop 2021-01-27T09:25:09.089 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- 172.21.15.47:0/1350274484 shutdown_connections 2021-01-27T09:25:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 --2- 172.21.15.47:0/1350274484 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c40fb620 0x7f46c40fdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 --2- 172.21.15.47:0/1350274484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c405f6d0 0x7f46c40f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 --2- 172.21.15.47:0/1350274484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40f8b90 0x7f46c40fafe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- 172.21.15.47:0/1350274484 >> 172.21.15.47:0/1350274484 conn(0x7f46c40f0110 msgr2=0x7f46c40f2550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- 172.21.15.47:0/1350274484 shutdown_connections 2021-01-27T09:25:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- 172.21.15.47:0/1350274484 wait complete. 2021-01-27T09:25:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 Processor -- start 2021-01-27T09:25:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.084+0000 7f46c98ee700 1 -- start start 2021-01-27T09:25:09.093 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c405f6d0 0x7f46c40f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c40f8b90 0x7f46c40f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:09.094 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40f5020 con 0x7f46c40fb620 2021-01-27T09:25:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40f5190 con 0x7f46c40f8b90 2021-01-27T09:25:09.095 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40f5350 con 0x7f46c405f6d0 2021-01-27T09:25:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c2ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c405f6d0 0x7f46c40f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c27fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c40f8b90 0x7f46c40f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38260/0 (socket says 172.21.15.47:38260) 2021-01-27T09:25:09.098 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 -- 172.21.15.47:0/4248794298 learned_addr learned my addr 172.21.15.47:0/4248794298 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:25:09.099 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 -- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c405f6d0 msgr2=0x7f46c40f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c405f6d0 0x7f46c40f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 -- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c40f8b90 msgr2=0x7f46c40f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c40f8b90 0x7f46c40f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.100 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 -- 172.21.15.47:0/4248794298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c410fb70 con 0x7f46c40fb620 2021-01-27T09:25:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c37fe700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f46b400de50 tx=0x7f46b4004f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4007e00 con 0x7f46c40fb620 2021-01-27T09:25:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c410fe20 con 0x7f46c40fb620 2021-01-27T09:25:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f46b400f040 con 0x7f46c40fb620 2021-01-27T09:25:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4110280 con 0x7f46c40fb620 2021-01-27T09:25:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4013b00 con 0x7f46c40fb620 2021-01-27T09:25:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.088+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4045420 con 0x7f46c40fb620 2021-01-27T09:25:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.092+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f46b401a030 con 0x7f46c40fb620 2021-01-27T09:25:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.092+0000 7f46bb7fe700 1 --2- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 0x7f46b005e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.092+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f46b4075750 con 0x7f46c40fb620 2021-01-27T09:25:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.092+0000 7f46c2ffd700 1 --2- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 0x7f46b005e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.092+0000 7f46c2ffd700 1 --2- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 0x7f46b005e1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f46bc004c40 tx=0x7f46bc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.096+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f46b40483c0 con 0x7f46c40fb620 2021-01-27T09:25:09.297 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.296+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi103=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c4100760 con 0x7f46b005bd20 2021-01-27T09:25:09.311 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled alertmanager update... 2021-01-27T09:25:09.311 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.308+0000 7f46bb7fe700 1 -- 172.21.15.47:0/4248794298 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f46c4100760 con 0x7f46b005bd20 2021-01-27T09:25:09.313 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 msgr2=0x7f46b005e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 0x7f46b005e1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f46bc004c40 tx=0x7f46bc00b040).stop 2021-01-27T09:25:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 msgr2=0x7f46c40f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:09.318 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f46b400de50 tx=0x7f46b4004f00).stop 2021-01-27T09:25:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 shutdown_connections 2021-01-27T09:25:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> v2:172.21.15.103:6800/3303543367 conn(0x7f46b005bd20 0x7f46b005e1e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c40fb620 0x7f46c40f4a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46c405f6d0 0x7f46c40f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 --2- 172.21.15.47:0/4248794298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46c40f8b90 0x7f46c40f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 >> 172.21.15.47:0/4248794298 conn(0x7f46c40f0110 msgr2=0x7f46c40fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 shutdown_connections 2021-01-27T09:25:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:09.312+0000 7f46c98ee700 1 -- 172.21.15.47:0/4248794298 wait complete. 2021-01-27T09:25:09.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:09 smithi047 bash[9721]: cluster 2021-01-27T09:25:08.224207+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 136 B/s, 2 objects/s recovering 2021-01-27T09:25:09.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:09 smithi047 bash[9721]: audit 2021-01-27T09:25:09.311575+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:09.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:09 smithi103 bash[13570]: cluster 2021-01-27T09:25:08.224207+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 136 B/s, 2 objects/s recovering 2021-01-27T09:25:09.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:09 smithi103 bash[13570]: audit 2021-01-27T09:25:09.311575+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:09.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:09 smithi103 bash[9772]: cluster 2021-01-27T09:25:08.224207+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 136 B/s, 2 objects/s recovering 2021-01-27T09:25:09.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:09 smithi103 bash[9772]: audit 2021-01-27T09:25:09.311575+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:10.509 DEBUG:teuthology.orchestra.run.smithi103:alertmanager.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@alertmanager.a.service 2021-01-27T09:25:10.516 INFO:tasks.cephadm:Adding grafana.a on smithi047 2021-01-27T09:25:10.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph orch apply grafana '1;smithi047=a' 2021-01-27T09:25:10.544 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:25:10.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:10 smithi103 bash[13570]: audit 2021-01-27T09:25:09.300864+0000 mgr.y (mgr.14138) 297 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi103=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:10.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:10 smithi103 bash[13570]: cephadm 2021-01-27T09:25:09.302966+0000 mgr.y (mgr.14138) 298 : cephadm [INF] Saving service alertmanager spec with placement smithi103=a;count:1 2021-01-27T09:25:10.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:10 smithi103 bash[9772]: audit 2021-01-27T09:25:09.300864+0000 mgr.y (mgr.14138) 297 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi103=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:10.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:10 smithi103 bash[9772]: cephadm 2021-01-27T09:25:09.302966+0000 mgr.y (mgr.14138) 298 : cephadm [INF] Saving service alertmanager spec with placement smithi103=a;count:1 2021-01-27T09:25:10.659 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:10 smithi047 bash[9721]: audit 2021-01-27T09:25:09.300864+0000 mgr.y (mgr.14138) 297 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi103=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:10.660 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:10 smithi047 bash[9721]: cephadm 2021-01-27T09:25:09.302966+0000 mgr.y (mgr.14138) 298 : cephadm [INF] Saving service alertmanager spec with placement smithi103=a;count:1 2021-01-27T09:25:11.060 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:10 smithi047 systemd[1]: Started Ceph prometheus.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:12.299 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:11 smithi047 bash[9721]: cluster 2021-01-27T09:25:10.225561+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 124 B/s, 2 objects/s recovering 2021-01-27T09:25:12.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:11 smithi047 bash[9721]: audit 2021-01-27T09:25:10.944469+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:12.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:11 smithi047 bash[9721]: audit 2021-01-27T09:25:10.947321+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:12.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[13570]: cluster 2021-01-27T09:25:10.225561+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 124 B/s, 2 objects/s recovering 2021-01-27T09:25:12.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[13570]: audit 2021-01-27T09:25:10.944469+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[13570]: audit 2021-01-27T09:25:10.947321+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[9772]: cluster 2021-01-27T09:25:10.225561+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 124 B/s, 2 objects/s recovering 2021-01-27T09:25:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[9772]: audit 2021-01-27T09:25:10.944469+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:12.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:11 smithi103 bash[9772]: audit 2021-01-27T09:25:10.947321+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:13.036 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-27T09:25:13.036 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-27T09:25:13.036 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-27T09:25:13.037 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi047 (none))" 2021-01-27T09:25:13.037 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-27T09:25:13.037 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.874Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-27T09:25:13.037 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.876Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-27T09:25:13.038 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.876Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-27T09:25:13.038 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.881Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-27T09:25:13.038 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.882Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-01-27T09:25:13.038 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.882Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=486.663µs 2021-01-27T09:25:13.038 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.883Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-27T09:25:13.039 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.883Z caller=main.go:695 msg="TSDB started" 2021-01-27T09:25:13.039 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.884Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T09:25:13.039 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.884Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T09:25:13.039 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:25:12 smithi047 bash[23146]: level=info ts=2021-01-27T09:25:12.884Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T09:25:13.960 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:13 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:13.961 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:13 smithi047 systemd[1]: Started Ceph node-exporter.b for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:14.299 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T09:25:14.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cluster 2021-01-27T09:25:12.226450+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:14.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: audit 2021-01-27T09:25:13.089276+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: audit 2021-01-27T09:25:13.096708+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.098629+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:14.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.099928+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:14.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.101167+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:14.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.102392+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:14.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.103150+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='b'), HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:14.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: cephadm 2021-01-27T09:25:13.103603+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.b on smithi047 2021-01-27T09:25:14.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[9721]: audit 2021-01-27T09:25:13.998679+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.355 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:13 smithi103 bash[10018]: debug 2021-01-27T09:25:13.900+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:14.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cluster 2021-01-27T09:25:12.226450+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:14.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: audit 2021-01-27T09:25:13.089276+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: audit 2021-01-27T09:25:13.096708+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.098629+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:14.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.099928+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:14.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.101167+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:14.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.102392+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:14.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.103150+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='b'), HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:14.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: cephadm 2021-01-27T09:25:13.103603+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.b on smithi047 2021-01-27T09:25:14.358 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[13570]: audit 2021-01-27T09:25:13.998679+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cluster 2021-01-27T09:25:12.226450+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:14.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: audit 2021-01-27T09:25:13.089276+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: audit 2021-01-27T09:25:13.096708+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.098629+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:14.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.099928+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:14.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.101167+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:14.359 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.102392+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:14.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.103150+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='b'), HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:14.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: cephadm 2021-01-27T09:25:13.103603+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.b on smithi047 2021-01-27T09:25:14.360 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[9772]: audit 2021-01-27T09:25:13.998679+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:14.810 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T09:25:14.810 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 49a2d53aa1af: Pulling fs layer 2021-01-27T09:25:14.810 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 3589a6efd9ce: Pulling fs layer 2021-01-27T09:25:14.811 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 190160031744: Pulling fs layer 2021-01-27T09:25:14.811 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 3589a6efd9ce: Download complete 2021-01-27T09:25:14.811 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 49a2d53aa1af: Verifying Checksum 2021-01-27T09:25:14.811 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 49a2d53aa1af: Download complete 2021-01-27T09:25:14.812 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 190160031744: Verifying Checksum 2021-01-27T09:25:14.812 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 190160031744: Download complete 2021-01-27T09:25:15.095 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:14 smithi103 systemd[1]: Started Ceph node-exporter.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:15.095 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:14 smithi103 bash[26155]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T09:25:15.171 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:15 smithi047 bash[9721]: audit 2021-01-27T09:25:13.905863+0000 mgr.y (mgr.14138) 307 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:15.171 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:15 smithi047 bash[9721]: cephadm 2021-01-27T09:25:14.000447+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Deploying daemon node-exporter.a on smithi103 2021-01-27T09:25:15.171 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:15 smithi047 bash[9721]: audit 2021-01-27T09:25:14.878950+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:15.171 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:14 smithi047 bash[23623]: 49a2d53aa1af: Pull complete 2021-01-27T09:25:15.368 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 -- 172.21.15.47:0/4115590178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f58c0 msgr2=0x7f26440f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:15.368 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 --2- 172.21.15.47:0/4115590178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f58c0 0x7f26440f5ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2634004e00 tx=0x7f2634009b30).stop 2021-01-27T09:25:15.368 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 -- 172.21.15.47:0/4115590178 shutdown_connections 2021-01-27T09:25:15.369 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 --2- 172.21.15.47:0/4115590178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f74b0 0x7f26440fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.369 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 --2- 172.21.15.47:0/4115590178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f58c0 0x7f26440f5ce0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.369 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 --2- 172.21.15.47:0/4115590178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f26440f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.369 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 -- 172.21.15.47:0/4115590178 >> 172.21.15.47:0/4115590178 conn(0x7f26440f10a0 msgr2=0x7f26440f34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:15.369 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 -- 172.21.15.47:0/4115590178 shutdown_connections 2021-01-27T09:25:15.370 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 -- 172.21.15.47:0/4115590178 wait complete. 2021-01-27T09:25:15.370 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.360+0000 7f2648a3e700 1 Processor -- start 2021-01-27T09:25:15.370 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- start start 2021-01-27T09:25:15.370 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 0x7f2644107af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:15.370 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:15.371 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 0x7f2644108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:15.371 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644109400 con 0x7f26440f74b0 2021-01-27T09:25:15.371 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644109570 con 0x7f26440f58c0 2021-01-27T09:25:15.371 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2644109730 con 0x7f26440f6b60 2021-01-27T09:25:15.371 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f26437fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 0x7f2644107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:15.372 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2642ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:15.372 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 0x7f2644108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:15.372 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2642ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.47:35060/0 (socket says 172.21.15.47:35060) 2021-01-27T09:25:15.372 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2642ffd700 1 -- 172.21.15.47:0/2277429901 learned_addr learned my addr 172.21.15.47:0/2277429901 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:25:15.372 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f26437fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 0x7f2644107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.47:42676/0 (socket says 172.21.15.47:42676) 2021-01-27T09:25:15.373 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 -- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 msgr2=0x7f2644107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:15.373 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.373 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 -- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 msgr2=0x7f2644107af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:15.373 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 0x7f2644107af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.373 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 -- 172.21.15.47:0/2277429901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26441098f0 con 0x7f26440f74b0 2021-01-27T09:25:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2642ffd700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:25:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2643fff700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 0x7f2644108ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f263c00eb10 tx=0x7f263c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0092e0 con 0x7f26440f74b0 2021-01-27T09:25:15.374 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2644109b40 con 0x7f26440f74b0 2021-01-27T09:25:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f263c00f040 con 0x7f26440f74b0 2021-01-27T09:25:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00c5b0 con 0x7f26440f74b0 2021-01-27T09:25:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26441102e0 con 0x7f26440f74b0 2021-01-27T09:25:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.364+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f263c00ca30 con 0x7f26440f74b0 2021-01-27T09:25:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.368+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26440f4cb0 con 0x7f26440f74b0 2021-01-27T09:25:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.368+0000 7f263bfff700 1 --2- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 0x7f262405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.368+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f263c075900 con 0x7f26440f74b0 2021-01-27T09:25:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.368+0000 7f26437fe700 1 --2- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 0x7f262405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.368+0000 7f26437fe700 1 --2- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 0x7f262405e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2634009c20 tx=0x7f2634009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.376+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f263c0468c0 con 0x7f26440f74b0 2021-01-27T09:25:15.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[9772]: audit 2021-01-27T09:25:13.905863+0000 mgr.y (mgr.14138) 307 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:15.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[9772]: cephadm 2021-01-27T09:25:14.000447+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Deploying daemon node-exporter.a on smithi103 2021-01-27T09:25:15.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[9772]: audit 2021-01-27T09:25:14.878950+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:15.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[13570]: audit 2021-01-27T09:25:13.905863+0000 mgr.y (mgr.14138) 307 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:15.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[13570]: cephadm 2021-01-27T09:25:14.000447+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Deploying daemon node-exporter.a on smithi103 2021-01-27T09:25:15.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[13570]: audit 2021-01-27T09:25:14.878950+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:15.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T09:25:15.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 49a2d53aa1af: Pulling fs layer 2021-01-27T09:25:15.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 3589a6efd9ce: Pulling fs layer 2021-01-27T09:25:15.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 190160031744: Pulling fs layer 2021-01-27T09:25:15.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 3589a6efd9ce: Verifying Checksum 2021-01-27T09:25:15.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 49a2d53aa1af: Download complete 2021-01-27T09:25:15.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 190160031744: Verifying Checksum 2021-01-27T09:25:15.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 190160031744: Download complete 2021-01-27T09:25:15.549 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:15 smithi047 bash[23623]: 3589a6efd9ce: Pull complete 2021-01-27T09:25:15.582 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.580+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f264406a510 con 0x7f262405bc70 2021-01-27T09:25:15.593 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f263bfff700 1 -- 172.21.15.47:0/2277429901 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f264406a510 con 0x7f262405bc70 2021-01-27T09:25:15.593 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled grafana update... 2021-01-27T09:25:15.596 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 msgr2=0x7f262405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 0x7f262405e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2634009c20 tx=0x7f2634009b30).stop 2021-01-27T09:25:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 msgr2=0x7f2644108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 0x7f2644108ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f263c00eb10 tx=0x7f263c00b040).stop 2021-01-27T09:25:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 shutdown_connections 2021-01-27T09:25:15.597 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> v2:172.21.15.103:6800/3303543367 conn(0x7f262405bc70 0x7f262405e130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26440f74b0 0x7f2644108ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440f58c0 0x7f2644107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 --2- 172.21.15.47:0/2277429901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26440f6b60 0x7f2644107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:15.598 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 >> 172.21.15.47:0/2277429901 conn(0x7f26440f10a0 msgr2=0x7f2644068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:15.599 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 shutdown_connections 2021-01-27T09:25:15.599 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:15.592+0000 7f2648a3e700 1 -- 172.21.15.47:0/2277429901 wait complete. 2021-01-27T09:25:15.893 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 49a2d53aa1af: Pull complete 2021-01-27T09:25:16.260 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:15 smithi047 bash[23623]: 190160031744: Pull complete 2021-01-27T09:25:16.261 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[9721]: cluster 2021-01-27T09:25:14.227475+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:16.261 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[9721]: cephadm 2021-01-27T09:25:14.880029+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:16.261 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[9721]: cephadm 2021-01-27T09:25:14.885275+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Deploying daemon alertmanager.a on smithi103 2021-01-27T09:25:16.261 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[9721]: audit 2021-01-27T09:25:15.592342+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:16.361 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:15 smithi103 bash[26155]: 3589a6efd9ce: Pull complete 2021-01-27T09:25:16.362 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[9772]: cluster 2021-01-27T09:25:14.227475+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:16.362 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[9772]: cephadm 2021-01-27T09:25:14.880029+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:16.362 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[9772]: cephadm 2021-01-27T09:25:14.885275+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Deploying daemon alertmanager.a on smithi103 2021-01-27T09:25:16.363 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[9772]: audit 2021-01-27T09:25:15.592342+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:16.363 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[13570]: cluster 2021-01-27T09:25:14.227475+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 61 B/s, 1 objects/s recovering 2021-01-27T09:25:16.363 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[13570]: cephadm 2021-01-27T09:25:14.880029+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi103', network='', name='a')] 2021-01-27T09:25:16.363 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[13570]: cephadm 2021-01-27T09:25:14.885275+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Deploying daemon alertmanager.a on smithi103 2021-01-27T09:25:16.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[13570]: audit 2021-01-27T09:25:15.592342+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:16.549 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[23623]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T09:25:16.550 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:16 smithi047 bash[23623]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T09:25:16.643 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[26155]: 190160031744: Pull complete 2021-01-27T09:25:16.643 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[26155]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T09:25:16.644 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:16 smithi103 bash[26155]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T09:25:17.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:17 smithi103 bash[13570]: audit 2021-01-27T09:25:15.585447+0000 mgr.y (mgr.14138) 312 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:17.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:17 smithi103 bash[13570]: cephadm 2021-01-27T09:25:15.586940+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Saving service grafana spec with placement smithi047=a;count:1 2021-01-27T09:25:17.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:17 smithi103 bash[9772]: audit 2021-01-27T09:25:15.585447+0000 mgr.y (mgr.14138) 312 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:17.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:17 smithi103 bash[9772]: cephadm 2021-01-27T09:25:15.586940+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Saving service grafana spec with placement smithi047=a;count:1 2021-01-27T09:25:17.549 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:17 smithi047 bash[9721]: audit 2021-01-27T09:25:15.585447+0000 mgr.y (mgr.14138) 312 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi047=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T09:25:17.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:17 smithi047 bash[9721]: cephadm 2021-01-27T09:25:15.586940+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Saving service grafana spec with placement smithi047=a;count:1 2021-01-27T09:25:17.559 DEBUG:teuthology.orchestra.run.smithi047:grafana.a> sudo journalctl -f -n 0 -u ceph-78337516-6080-11eb-8f9a-001a4aab830c@grafana.a.service 2021-01-27T09:25:17.562 INFO:tasks.cephadm:Setting up client nodes... 2021-01-27T09:25:17.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T09:25:17.663 INFO:journalctl@ceph.grafana.a.smithi047.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T09:25:18.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[9721]: cluster 2021-01-27T09:25:16.228618+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:18.301 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T09:25:18.301 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T09:25:18.302 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T09:25:18.302 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T09:25:18.302 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T09:25:18.302 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T09:25:18.303 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T09:25:18.303 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T09:25:18.303 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T09:25:18.303 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T09:25:18.303 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T09:25:18.304 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T09:25:18.304 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T09:25:18.304 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T09:25:18.304 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T09:25:18.305 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T09:25:18.305 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T09:25:18.305 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T09:25:18.305 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T09:25:18.305 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T09:25:18.306 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T09:25:18.306 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T09:25:18.306 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T09:25:18.306 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T09:25:18.307 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T09:25:18.307 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T09:25:18.307 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T09:25:18.307 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T09:25:18.307 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T09:25:18.308 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T09:25:18.308 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T09:25:18.308 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T09:25:18.308 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T09:25:18.308 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T09:25:18.309 INFO:journalctl@ceph.node-exporter.b.smithi047.stdout:Jan 27 09:25:18 smithi047 bash[23623]: time="2021-01-27T09:25:18Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T09:25:18.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:18 smithi103 bash[9772]: cluster 2021-01-27T09:25:16.228618+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:18.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:18 smithi103 bash[13570]: cluster 2021-01-27T09:25:16.228618+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:20.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[13570]: cluster 2021-01-27T09:25:18.229597+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:20.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[9772]: cluster 2021-01-27T09:25:18.229597+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:20.394 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T09:25:20.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T09:25:20.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T09:25:20.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T09:25:20.395 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T09:25:20.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T09:25:20.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T09:25:20.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T09:25:20.396 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T09:25:20.397 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T09:25:20.397 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T09:25:20.397 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T09:25:20.397 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T09:25:20.397 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T09:25:20.398 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T09:25:20.398 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T09:25:20.398 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T09:25:20.398 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T09:25:20.399 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T09:25:20.400 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T09:25:20.400 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T09:25:20.400 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T09:25:20.400 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T09:25:20.401 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T09:25:20.401 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T09:25:20.401 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T09:25:20.401 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T09:25:20.401 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T09:25:20.402 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T09:25:20.402 INFO:journalctl@ceph.node-exporter.a.smithi103.stdout:Jan 27 09:25:20 smithi103 bash[26155]: time="2021-01-27T09:25:20Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T09:25:20.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:20 smithi047 bash[9721]: cluster 2021-01-27T09:25:18.229597+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:22.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:22 smithi103 bash[13570]: cluster 2021-01-27T09:25:20.231035+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:22.251 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:22 smithi103 bash[9772]: cluster 2021-01-27T09:25:20.231035+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:22.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:22 smithi047 bash[9721]: cluster 2021-01-27T09:25:20.231035+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/1168974157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f47a0 msgr2=0x7f4e240f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/1168974157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f47a0 0x7f4e240f4bc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4e14009df0 tx=0x7f4e14004d10).stop 2021-01-27T09:25:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/1168974157 shutdown_connections 2021-01-27T09:25:23.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/1168974157 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f6390 0x7f4e240fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:23.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/1168974157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f47a0 0x7f4e240f4bc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:23.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/1168974157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f5a40 0x7f4e240f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:23.993 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/1168974157 >> 172.21.15.103:0/1168974157 conn(0x7f4e240effa0 msgr2=0x7f4e240f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/1168974157 shutdown_connections 2021-01-27T09:25:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/1168974157 wait complete. 2021-01-27T09:25:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 Processor -- start 2021-01-27T09:25:23.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- start start 2021-01-27T09:25:23.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f47a0 0x7f4e240f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:23.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 0x7f4e240f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:23.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 0x7f4e240f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:23.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240f7ac0 con 0x7f4e240f47a0 2021-01-27T09:25:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240f7c30 con 0x7f4e240f6390 2021-01-27T09:25:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e2ac6c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2410f910 con 0x7f4e240f5a40 2021-01-27T09:25:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.987+0000 7f4e29469700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 0x7f4e240f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 0x7f4e240f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e29469700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 0x7f4e240f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32784/0 (socket says 172.21.15.103:32784) 2021-01-27T09:25:23.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e29469700 1 -- 172.21.15.103:0/581616733 learned_addr learned my addr 172.21.15.103:0/581616733 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:23.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e29c6a700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f47a0 0x7f4e240f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:23.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 -- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 msgr2=0x7f4e240f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:23.998 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 0x7f4e240f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:23.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 -- 172.21.15.103:0/581616733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f47a0 msgr2=0x7f4e240f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:23.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f47a0 0x7f4e240f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:23.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 -- 172.21.15.103:0/581616733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2410fad0 con 0x7f4e240f6390 2021-01-27T09:25:23.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2a46b700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 0x7f4e240f73d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4e1c00eb10 tx=0x7f4e1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:23.999 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0092e0 con 0x7f4e240f6390 2021-01-27T09:25:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2410fd20 con 0x7f4e240f6390 2021-01-27T09:25:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4e1c00f040 con 0x7f4e240f6390 2021-01-27T09:25:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00c5b0 con 0x7f4e240f6390 2021-01-27T09:25:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24110280 con 0x7f4e240f6390 2021-01-27T09:25:24.001 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.991+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e240f3b90 con 0x7f4e240f6390 2021-01-27T09:25:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.995+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f4e1c009440 con 0x7f4e240f6390 2021-01-27T09:25:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.995+0000 7f4e227fc700 1 --2- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 0x7f4e0c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.995+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f4e1c075820 con 0x7f4e240f6390 2021-01-27T09:25:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.995+0000 7f4e29c6a700 1 --2- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 0x7f4e0c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:24.003 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:23.995+0000 7f4e29c6a700 1 --2- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 0x7f4e0c05e130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4e14004e00 tx=0x7f4e14004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:24.005 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.003+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f4e1c0468c0 con 0x7f4e240f6390 2021-01-27T09:25:24.127 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:23 smithi103 bash[10018]: debug 2021-01-27T09:25:23.907+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:24.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.231+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f4e24110890 con 0x7f4e240f6390 2021-01-27T09:25:24.242 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e227fc700 1 -- 172.21.15.103:0/581616733 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7f4e1c048490 con 0x7f4e240f6390 2021-01-27T09:25:24.243 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2021-01-27T09:25:24.243 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQCEMRFgRpUgDhAAeskscC2zE4NxZ2KPaTuogA== 2021-01-27T09:25:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 msgr2=0x7f4e0c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 0x7f4e0c05e130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4e14004e00 tx=0x7f4e14004d10).stop 2021-01-27T09:25:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 msgr2=0x7f4e240f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 0x7f4e240f73d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4e1c00eb10 tx=0x7f4e1c00b040).stop 2021-01-27T09:25:24.246 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 shutdown_connections 2021-01-27T09:25:24.246 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> v2:172.21.15.103:6800/3303543367 conn(0x7f4e0c05bc70 0x7f4e0c05e130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:24.246 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e240f6390 0x7f4e240f73d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:24.246 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e240f47a0 0x7f4e240f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:24.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 --2- 172.21.15.103:0/581616733 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e240f5a40 0x7f4e240f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:24.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.239+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 >> 172.21.15.103:0/581616733 conn(0x7f4e240effa0 msgr2=0x7f4e240f0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:24.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.243+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 shutdown_connections 2021-01-27T09:25:24.248 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:24.243+0000 7f4e2ac6c700 1 -- 172.21.15.103:0/581616733 wait complete. 2021-01-27T09:25:24.300 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:24 smithi047 bash[9721]: cluster 2021-01-27T09:25:22.231873+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:24.300 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:23 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:24.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:24 smithi103 bash[9772]: cluster 2021-01-27T09:25:22.231873+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:24.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:24 smithi103 bash[13570]: cluster 2021-01-27T09:25:22.231873+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:25.299 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:25:25.299 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-01-27T09:25:25.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-27T09:25:25.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T09:25:25.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[9772]: audit 2021-01-27T09:25:23.910966+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:25.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[9772]: audit 2021-01-27T09:25:24.236619+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:25.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[9772]: audit 2021-01-27T09:25:24.243169+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:25.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[13570]: audit 2021-01-27T09:25:23.910966+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:25.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[13570]: audit 2021-01-27T09:25:24.236619+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:25.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:25 smithi103 bash[13570]: audit 2021-01-27T09:25:24.243169+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:25.516 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:25 smithi047 bash[9721]: audit 2021-01-27T09:25:23.910966+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:25.517 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:25 smithi047 bash[9721]: audit 2021-01-27T09:25:24.236619+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:25.517 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:25 smithi047 bash[9721]: audit 2021-01-27T09:25:24.243169+0000 mon.a (mon.0) 612 : audit [INF] from='client.? 172.21.15.103:0/581616733' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:26.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:26 smithi103 bash[13570]: cluster 2021-01-27T09:25:24.232554+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:26.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:26 smithi103 bash[9772]: cluster 2021-01-27T09:25:24.232554+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:26.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:26 smithi047 bash[9721]: cluster 2021-01-27T09:25:24.232554+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:26.768 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:26 smithi103 systemd[1]: Started Ceph alertmanager.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:27.796 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:27 smithi047 bash[9721]: cluster 2021-01-27T09:25:26.233621+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:27.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:27 smithi047 bash[9721]: audit 2021-01-27T09:25:26.716200+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:27.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:27 smithi047 bash[9721]: audit 2021-01-27T09:25:26.718148+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:27.797 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:27 smithi047 bash[9721]: audit 2021-01-27T09:25:26.718538+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:27.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[13570]: cluster 2021-01-27T09:25:26.233621+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:27.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[13570]: audit 2021-01-27T09:25:26.716200+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:27.975 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[13570]: audit 2021-01-27T09:25:26.718148+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:27.975 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[13570]: audit 2021-01-27T09:25:26.718538+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:27.975 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[9772]: cluster 2021-01-27T09:25:26.233621+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:27.975 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[9772]: audit 2021-01-27T09:25:26.716200+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:27.975 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[9772]: audit 2021-01-27T09:25:26.718148+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:27.976 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:27 smithi103 bash[9772]: audit 2021-01-27T09:25:26.718538+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:28.394 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.031Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T09:25:28.395 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.031Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T09:25:28.395 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.033Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.103 port=9094 2021-01-27T09:25:28.395 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.035Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T09:25:28.396 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.068Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T09:25:28.396 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.068Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T09:25:28.396 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:28 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:28.071Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T09:25:29.138 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/430347010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc0fadd0 msgr2=0x7fd9bc0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- 172.21.15.47:0/430347010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc0fd1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd9ac004d40 tx=0x7fd9ac009b30).stop 2021-01-27T09:25:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/430347010 shutdown_connections 2021-01-27T09:25:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- 172.21.15.47:0/430347010 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc0ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- 172.21.15.47:0/430347010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc05f670 0x7fd9bc0fa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- 172.21.15.47:0/430347010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc0fd1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/430347010 >> 172.21.15.47:0/430347010 conn(0x7fd9bc0effa0 msgr2=0x7fd9bc0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/430347010 shutdown_connections 2021-01-27T09:25:29.140 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/430347010 wait complete. 2021-01-27T09:25:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 Processor -- start 2021-01-27T09:25:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- start start 2021-01-27T09:25:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc108e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1093b0 con 0x7fd9bc05f670 2021-01-27T09:25:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc109520 con 0x7fd9bc0fadd0 2021-01-27T09:25:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1096e0 con 0x7fd9bc0fd6b0 2021-01-27T09:25:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1062700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc108e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38306/0 (socket says 172.21.15.47:38306) 2021-01-27T09:25:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 -- 172.21.15.47:0/1364744207 learned_addr learned my addr 172.21.15.47:0/1364744207 (peer_addr_for_me v2:172.21.15.47:0/0) 2021-01-27T09:25:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9bbfff700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 -- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 msgr2=0x7fd9bc108e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc108e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 -- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc0fadd0 msgr2=0x7fd9bc107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 -- 172.21.15.47:0/1364744207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc1098a0 con 0x7fd9bc05f670 2021-01-27T09:25:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1062700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:25:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c0861700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd9b000eb90 tx=0x7fd9b000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00092e0 con 0x7fd9bc05f670 2021-01-27T09:25:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc109b50 con 0x7fd9bc05f670 2021-01-27T09:25:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fd9b000f040 con 0x7fd9bc05f670 2021-01-27T09:25:29.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000c840 con 0x7fd9bc05f670 2021-01-27T09:25:29.147 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.139+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc1102e0 con 0x7fd9bc05f670 2021-01-27T09:25:29.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc0f3b90 con 0x7fd9bc05f670 2021-01-27T09:25:29.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fd9b000cbf0 con 0x7fd9bc05f670 2021-01-27T09:25:29.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9b97fa700 1 --2- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 0x7fd9a405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:29.148 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fd9b0075740 con 0x7fd9bc05f670 2021-01-27T09:25:29.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9bbfff700 1 --2- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 0x7fd9a405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:29.149 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.143+0000 7fd9bbfff700 1 --2- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 0x7fd9a405e130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd9ac00b690 tx=0x7fd9ac009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:29.152 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.151+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fd9b00468c0 con 0x7fd9bc05f670 2021-01-27T09:25:29.396 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.395+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd9bc027100 con 0x7fd9bc05f670 2021-01-27T09:25:29.405 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9b97fa700 1 -- 172.21.15.47:0/1364744207 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd9b00190f0 con 0x7fd9bc05f670 2021-01-27T09:25:29.406 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2021-01-27T09:25:29.406 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCJMRFgj6a8FxAAa00MCVp2LKnxq2/EIZFb1Q== 2021-01-27T09:25:29.408 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 msgr2=0x7fd9a405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:29.408 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 0x7fd9a405e130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd9ac00b690 tx=0x7fd9ac009b30).stop 2021-01-27T09:25:29.408 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 msgr2=0x7fd9bc107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:29.409 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd9b000eb90 tx=0x7fd9b000b040).stop 2021-01-27T09:25:29.409 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 shutdown_connections 2021-01-27T09:25:29.409 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd9a405bc70 0x7fd9a405e130 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.409 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9bc0fd6b0 0x7fd9bc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.409 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9bc05f670 0x7fd9bc107aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.410 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 --2- 172.21.15.47:0/1364744207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9bc0fadd0 0x7fd9bc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:29.410 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 >> 172.21.15.47:0/1364744207 conn(0x7fd9bc0effa0 msgr2=0x7fd9bc0fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:29.410 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 shutdown_connections 2021-01-27T09:25:29.411 INFO:teuthology.orchestra.run.smithi047.stderr:2021-01-27T09:25:29.407+0000 7fd9c1863700 1 -- 172.21.15.47:0/1364744207 wait complete. 2021-01-27T09:25:29.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cluster 2021-01-27T09:25:28.234276+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:28.297488+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:28.932107+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:28.938425+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.939818+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:29.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.940716+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:29.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.941518+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:29.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.942291+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.943030+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:29.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.943759+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:28.944530+0000 mgr.y (mgr.14138) 328 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:25:29.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:29.066902+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:29.073897+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:29.075008+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:29.075883+0000 mgr.y (mgr.14138) 329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: audit 2021-01-27T09:25:29.081846+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:29 smithi047 bash[9721]: cephadm 2021-01-27T09:25:29.088103+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon grafana.a on smithi047 2021-01-27T09:25:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cluster 2021-01-27T09:25:28.234276+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:28.297488+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:28.932107+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:28.938425+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.939818+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.940716+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:29.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.941518+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:29.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.942291+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.943030+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:29.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.943759+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:28.944530+0000 mgr.y (mgr.14138) 328 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:25:29.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:29.066902+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:29.073897+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:29.075008+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:29.075883+0000 mgr.y (mgr.14138) 329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: audit 2021-01-27T09:25:29.081846+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[9772]: cephadm 2021-01-27T09:25:29.088103+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon grafana.a on smithi047 2021-01-27T09:25:29.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cluster 2021-01-27T09:25:28.234276+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:29.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:28.297488+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:28.932107+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:28.938425+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.939818+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:29.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.940716+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:29.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.941518+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:29.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.942291+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.943030+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:29.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.943759+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:29.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:28.944530+0000 mgr.y (mgr.14138) 328 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi047', network='', name='a')] 2021-01-27T09:25:29.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:29.066902+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:29.073897+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:29.075008+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:29.075883+0000 mgr.y (mgr.14138) 329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T09:25:29.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: audit 2021-01-27T09:25:29.081846+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:29.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:29 smithi103 bash[13570]: cephadm 2021-01-27T09:25:29.088103+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon grafana.a on smithi047 2021-01-27T09:25:30.251 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2021-01-27T09:25:30.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-01-27T09:25:30.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-27T09:25:30.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T09:25:30.289 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:30.036Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000223559s 2021-01-27T09:25:30.435 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:30.550 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:30 smithi047 bash[9721]: audit 2021-01-27T09:25:29.397784+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:30 smithi047 bash[9721]: audit 2021-01-27T09:25:29.398261+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.47:0/1364744207' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:30 smithi047 bash[9721]: audit 2021-01-27T09:25:29.405337+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:30.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[9772]: audit 2021-01-27T09:25:29.397784+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[9772]: audit 2021-01-27T09:25:29.398261+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.47:0/1364744207' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[9772]: audit 2021-01-27T09:25:29.405337+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:30.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[13570]: audit 2021-01-27T09:25:29.397784+0000 mon.a (mon.0) 623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[13570]: audit 2021-01-27T09:25:29.398261+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.47:0/1364744207' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T09:25:30.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:30 smithi103 bash[13570]: audit 2021-01-27T09:25:29.405337+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T09:25:31.678 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:31 smithi103 bash[13570]: cluster 2021-01-27T09:25:30.235907+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:31.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:31 smithi103 bash[9772]: cluster 2021-01-27T09:25:30.235907+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:31.800 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:31 smithi047 bash[9721]: cluster 2021-01-27T09:25:30.235907+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- 172.21.15.103:0/164164775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f266805fbe0 msgr2=0x7f26680f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- 172.21.15.103:0/164164775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f266805fbe0 0x7f26680f8600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f2664004e00 tx=0x7f2664009b30).stop 2021-01-27T09:25:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- 172.21.15.103:0/164164775 shutdown_connections 2021-01-27T09:25:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- 172.21.15.103:0/164164775 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26680fb610 0x7f26680fdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- 172.21.15.103:0/164164775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f266805fbe0 0x7f26680f8600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- 172.21.15.103:0/164164775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680f8b80 0x7f26680fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- 172.21.15.103:0/164164775 >> 172.21.15.103:0/164164775 conn(0x7f26680f0120 msgr2=0x7f26680f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- 172.21.15.103:0/164164775 shutdown_connections 2021-01-27T09:25:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- 172.21.15.103:0/164164775 wait complete. 2021-01-27T09:25:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 Processor -- start 2021-01-27T09:25:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- start start 2021-01-27T09:25:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26680f8b80 0x7f2668107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 0x7f266810f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266810f580 con 0x7f26680fb610 2021-01-27T09:25:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266810f6c0 con 0x7f26680f8b80 2021-01-27T09:25:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.402+0000 7f2670598700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266810f800 con 0x7f266805fbe0 2021-01-27T09:25:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266db33700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26680f8b80 0x7f2668107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32796/0 (socket says 172.21.15.103:32796) 2021-01-27T09:25:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 -- 172.21.15.103:0/1898549383 learned_addr learned my addr 172.21.15.103:0/1898549383 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266eb35700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 0x7f266810f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 -- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26680f8b80 msgr2=0x7f2668107fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26680f8b80 0x7f2668107fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 -- 172.21.15.103:0/1898549383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 msgr2=0x7f266810f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 0x7f266810f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 -- 172.21.15.103:0/1898549383 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266810f9c0 con 0x7f266805fbe0 2021-01-27T09:25:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266eb35700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 0x7f266810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:25:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f266e334700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2664009c20 tx=0x7f2664009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400e030 con 0x7f266805fbe0 2021-01-27T09:25:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2664013a80 con 0x7f266805fbe0 2021-01-27T09:25:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266810fc10 con 0x7f266805fbe0 2021-01-27T09:25:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664018070 con 0x7f266805fbe0 2021-01-27T09:25:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2668110010 con 0x7f266805fbe0 2021-01-27T09:25:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266805e700 con 0x7f266805fbe0 2021-01-27T09:25:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.406+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f2664013620 con 0x7f266805fbe0 2021-01-27T09:25:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.410+0000 7f265effd700 1 --2- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 0x7f265405e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.410+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f2664077a30 con 0x7f266805fbe0 2021-01-27T09:25:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.410+0000 7f266db33700 1 --2- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 0x7f265405e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.410+0000 7f266db33700 1 --2- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 0x7f265405e1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f266805f9b0 tx=0x7f265800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.418+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f266404a790 con 0x7f266805fbe0 2021-01-27T09:25:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.578+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f266805e700 con 0x7f266805fbe0 2021-01-27T09:25:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f265effd700 1 -- 172.21.15.103:0/1898549383 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18946 (secure 0 0 0) 0x7f266805e700 con 0x7f266805fbe0 2021-01-27T09:25:33.583 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:25:33.583 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":60,"fsid":"78337516-6080-11eb-8f9a-001a4aab830c","created":"2021-01-27T09:18:01.588153+0000","modified":"2021-01-27T09:24:59.213295+0000","last_up_change":"2021-01-27T09:24:21.305208+0000","last_in_change":"2021-01-27T09:24:21.305208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:19:50.945648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T09:24:16.794776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T09:24:36.207617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T09:24:36.720591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T09:24:38.736112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T09:24:41.735968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"1f24ac20-7f89-43af-a3a8-639f9c8f6050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2602844757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2602844757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2602844757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2602844757}]},"public_addr":"172.21.15.103:6801/2602844757","cluster_addr":"172.21.15.103:6802/2602844757","heartbeat_back_addr":"172.21.15.103:6804/2602844757","heartbeat_front_addr":"172.21.15.103:6803/2602844757","state":["exists","up"]},{"osd":1,"uuid":"9402fe53-72fb-42a6-abd3-eb3566983eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":2521419055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2521419055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2521419055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2521419055}]},"public_addr":"172.21.15.103:6805/2521419055","cluster_addr":"172.21.15.103:6806/2521419055","heartbeat_back_addr":"172.21.15.103:6808/2521419055","heartbeat_front_addr":"172.21.15.103:6807/2521419055","state":["exists","up"]},{"osd":2,"uuid":"ea23a69b-462d-45da-ba68-854ae5a3f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":3547869492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3547869492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3547869492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":3547869492}]},"public_addr":"172.21.15.103:6809/3547869492","cluster_addr":"172.21.15.103:6810/3547869492","heartbeat_back_addr":"172.21.15.103:6812/3547869492","heartbeat_front_addr":"172.21.15.103:6811/3547869492","state":["exists","up"]},{"osd":3,"uuid":"4cbd1716-a15a-4236-a1d4-690a914a5e55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6813","nonce":3546808739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3546808739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3546808739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6815","nonce":3546808739}]},"public_addr":"172.21.15.103:6813/3546808739","cluster_addr":"172.21.15.103:6814/3546808739","heartbeat_back_addr":"172.21.15.103:6816/3546808739","heartbeat_front_addr":"172.21.15.103:6815/3546808739","state":["exists","up"]},{"osd":4,"uuid":"236c2a5a-cd0f-4473-9374-76acb70278a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4117565580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":4117565580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":4117565580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4117565580}]},"public_addr":"172.21.15.47:6800/4117565580","cluster_addr":"172.21.15.47:6801/4117565580","heartbeat_back_addr":"172.21.15.47:6803/4117565580","heartbeat_front_addr":"172.21.15.47:6802/4117565580","state":["exists","up"]},{"osd":5,"uuid":"85931400-41a6-4838-aec6-8e7c174de20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2359739468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":2359739468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":2359739468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2359739468}]},"public_addr":"172.21.15.47:6804/2359739468","cluster_addr":"172.21.15.47:6805/2359739468","heartbeat_back_addr":"172.21.15.47:6807/2359739468","heartbeat_front_addr":"172.21.15.47:6806/2359739468","state":["exists","up"]},{"osd":6,"uuid":"8f56216b-b2c6-49af-83bd-371ed5651fb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":4157251446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":4157251446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":4157251446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":4157251446}]},"public_addr":"172.21.15.47:6808/4157251446","cluster_addr":"172.21.15.47:6809/4157251446","heartbeat_back_addr":"172.21.15.47:6811/4157251446","heartbeat_front_addr":"172.21.15.47:6810/4157251446","state":["exists","up"]},{"osd":7,"uuid":"c6c2ce68-a2c6-4b28-953c-4b1f08268400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1597879315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":1597879315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1597879315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1597879315}]},"public_addr":"172.21.15.47:6812/1597879315","cluster_addr":"172.21.15.47:6813/1597879315","heartbeat_back_addr":"172.21.15.47:6815/1597879315","heartbeat_front_addr":"172.21.15.47:6814/1597879315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:05.684210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:32.644783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:00.399048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:26.300080+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:53.132045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:21.575028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:50.871249+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:24:19.565757+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/3379424216":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/2682866920":"2021-01-28T09:18:58.052053+0000","172.21.15.103:0/164987907":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/662320151":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/9391381":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/1666229793":"2021-01-28T09:18:37.071944+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:25:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 msgr2=0x7f265405e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 0x7f265405e1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f266805f9b0 tx=0x7f265800b040).stop 2021-01-27T09:25:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 msgr2=0x7f2668107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2664009c20 tx=0x7f2664009b30).stop 2021-01-27T09:25:33.587 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 shutdown_connections 2021-01-27T09:25:33.587 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> v2:172.21.15.103:6800/3303543367 conn(0x7f265405bd20 0x7f265405e1e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.587 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26680fb610 0x7f266810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.587 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f266805fbe0 0x7f2668107ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.588 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 --2- 172.21.15.103:0/1898549383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26680f8b80 0x7f2668107fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:33.588 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.582+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 >> 172.21.15.103:0/1898549383 conn(0x7f26680f0120 msgr2=0x7f26680f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:33.588 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.586+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 shutdown_connections 2021-01-27T09:25:33.588 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:33.586+0000 7f2670598700 1 -- 172.21.15.103:0/1898549383 wait complete. 2021-01-27T09:25:33.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:33 smithi103 bash[9772]: cluster 2021-01-27T09:25:32.236810+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:33.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:33 smithi103 bash[13570]: cluster 2021-01-27T09:25:32.236810+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:33.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:33 smithi047 bash[9721]: cluster 2021-01-27T09:25:32.236810+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:34.145 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:33 smithi103 bash[10018]: debug 2021-01-27T09:25:33.922+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:34.301 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:33 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:34.322 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:19:50.945648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-01-27T09:24:16.794776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-01-27T09:24:36.207617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.log', 'create_time': '2021-01-27T09:24:36.720591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.control', 'create_time': '2021-01-27T09:24:38.736112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'zone.rgw.meta', 'create_time': '2021-01-27T09:24:41.735968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-01-27T09:25:34.323 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-01-27T09:25:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:34.573 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:34 smithi103 bash[13570]: audit 2021-01-27T09:25:33.580805+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.103:0/1898549383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:25:34.573 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:34 smithi103 bash[13570]: audit 2021-01-27T09:25:33.922315+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:34.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:34 smithi103 bash[9772]: audit 2021-01-27T09:25:33.580805+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.103:0/1898549383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:25:34.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:34 smithi103 bash[9772]: audit 2021-01-27T09:25:33.922315+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:34.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:34 smithi047 bash[9721]: audit 2021-01-27T09:25:33.580805+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.103:0/1898549383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:25:34.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:34 smithi047 bash[9721]: audit 2021-01-27T09:25:33.922315+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:35.759 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:35 smithi103 bash[9772]: cluster 2021-01-27T09:25:34.237990+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:35.759 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:35 smithi103 bash[13570]: cluster 2021-01-27T09:25:34.237990+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:35.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:35 smithi047 bash[9721]: cluster 2021-01-27T09:25:34.237990+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/1011937699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 msgr2=0x7f71500fafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- 172.21.15.103:0/1011937699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f71500fafd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7138004d40 tx=0x7f7138009b30).stop 2021-01-27T09:25:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/1011937699 shutdown_connections 2021-01-27T09:25:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- 172.21.15.103:0/1011937699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f71500fdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- 172.21.15.103:0/1011937699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f71500f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- 172.21.15.103:0/1011937699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f71500fafd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/1011937699 >> 172.21.15.103:0/1011937699 conn(0x7f71500f0120 msgr2=0x7f71500f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/1011937699 shutdown_connections 2021-01-27T09:25:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/1011937699 wait complete. 2021-01-27T09:25:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 Processor -- start 2021-01-27T09:25:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- start start 2021-01-27T09:25:37.343 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f7150105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f7150105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715010d3c0 con 0x7f715005fbc0 2021-01-27T09:25:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715010d500 con 0x7f71500f8be0 2021-01-27T09:25:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715010d640 con 0x7f71500fb610 2021-01-27T09:25:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32812/0 (socket says 172.21.15.103:32812) 2021-01-27T09:25:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 -- 172.21.15.103:0/630818289 learned_addr learned my addr 172.21.15.103:0/630818289 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714effd700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f7150105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 -- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 msgr2=0x7f7150105df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f7150105df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714f7fe700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f7150105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 -- 172.21.15.103:0/630818289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 msgr2=0x7f7150105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f7150105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 -- 172.21.15.103:0/630818289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715010d800 con 0x7f71500fb610 2021-01-27T09:25:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714f7fe700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f7150105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:25:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f714ffff700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f714000ee40 tx=0x7f714000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000ee70 con 0x7f71500fb610 2021-01-27T09:25:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f714000f040 con 0x7f71500fb610 2021-01-27T09:25:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.337+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715010da50 con 0x7f71500fb610 2021-01-27T09:25:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140007620 con 0x7f71500fb610 2021-01-27T09:25:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715010df40 con 0x7f71500fb610 2021-01-27T09:25:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7150045420 con 0x7f71500fb610 2021-01-27T09:25:37.349 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f7140004020 con 0x7f71500fb610 2021-01-27T09:25:37.349 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7147fff700 1 --2- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 0x7f713c05e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:37.350 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f7140075ba0 con 0x7f71500fb610 2021-01-27T09:25:37.352 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.341+0000 7f714f7fe700 1 --2- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 0x7f713c05e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:37.352 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.345+0000 7f714f7fe700 1 --2- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 0x7f713c05e1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7148009fd0 tx=0x7f714800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:37.353 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.349+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f71400468c0 con 0x7f71500fb610 2021-01-27T09:25:37.519 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7150027100 con 0x7f71500fb610 2021-01-27T09:25:37.520 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7147fff700 1 -- 172.21.15.103:0/630818289 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v60) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7140048720 con 0x7f71500fb610 2021-01-27T09:25:37.520 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2021-01-27T09:25:37.521 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 msgr2=0x7f713c05e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:37.521 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 0x7f713c05e1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7148009fd0 tx=0x7f714800b040).stop 2021-01-27T09:25:37.522 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 msgr2=0x7f715010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:37.522 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f714000ee40 tx=0x7f714000b040).stop 2021-01-27T09:25:37.522 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 shutdown_connections 2021-01-27T09:25:37.522 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f713c05bd20 0x7f713c05e1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.523 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71500fb610 0x7f715010ced0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.523 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715005fbc0 0x7f7150105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.523 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 --2- 172.21.15.103:0/630818289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500f8be0 0x7f7150105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:37.523 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 >> 172.21.15.103:0/630818289 conn(0x7f71500f0120 msgr2=0x7f71500f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 shutdown_connections 2021-01-27T09:25:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:37.517+0000 7f7155cae700 1 -- 172.21.15.103:0/630818289 wait complete. 2021-01-27T09:25:37.691 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:37 smithi103 bash[13570]: cluster 2021-01-27T09:25:36.239135+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:37.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:37 smithi103 bash[9772]: cluster 2021-01-27T09:25:36.239135+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:37.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:37 smithi047 bash[9721]: cluster 2021-01-27T09:25:36.239135+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:38.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-01-27T09:25:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:38.365 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:38 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:38.037Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001142426s 2021-01-27T09:25:38.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:38 smithi103 bash[9772]: audit 2021-01-27T09:25:37.518968+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.103:0/630818289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T09:25:38.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:38 smithi103 bash[13570]: audit 2021-01-27T09:25:37.518968+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.103:0/630818289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T09:25:38.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:38 smithi047 bash[9721]: audit 2021-01-27T09:25:37.518968+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.103:0/630818289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T09:25:39.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:39 smithi103 bash[9772]: cluster 2021-01-27T09:25:38.240050+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:39.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:39 smithi103 bash[13570]: cluster 2021-01-27T09:25:38.240050+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:39.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:39 smithi047 bash[9721]: cluster 2021-01-27T09:25:38.240050+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:41.372 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/825045659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f7aa0 msgr2=0x7f86700f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:41.372 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- 172.21.15.103:0/825045659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f7aa0 0x7f86700f7ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8660009e10 tx=0x7f8660004c50).stop 2021-01-27T09:25:41.372 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/825045659 shutdown_connections 2021-01-27T09:25:41.372 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- 172.21.15.103:0/825045659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f94c0 0x7f8670100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.373 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- 172.21.15.103:0/825045659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f7aa0 0x7f86700f7ec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.373 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- 172.21.15.103:0/825045659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86700f83b0 0x7f86700f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.373 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/825045659 >> 172.21.15.103:0/825045659 conn(0x7f86700f3390 msgr2=0x7f86700f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:41.373 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/825045659 shutdown_connections 2021-01-27T09:25:41.374 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/825045659 wait complete. 2021-01-27T09:25:41.374 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 Processor -- start 2021-01-27T09:25:41.374 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- start start 2021-01-27T09:25:41.375 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 0x7f8670107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:41.375 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:41.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8670109170 0x7f86701095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:41.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670109b20 con 0x7f8670109170 2021-01-27T09:25:41.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670109c90 con 0x7f86700f83b0 2021-01-27T09:25:41.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8670109e50 con 0x7f86700f94c0 2021-01-27T09:25:41.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:41.377 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 0x7f8670107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:41.378 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32824/0 (socket says 172.21.15.103:32824) 2021-01-27T09:25:41.378 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 -- 172.21.15.103:0/989295441 learned_addr learned my addr 172.21.15.103:0/989295441 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:41.379 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866f7fe700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8670109170 0x7f86701095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:41.379 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 -- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 msgr2=0x7f8670107ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:41.379 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 0x7f8670107ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.380 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 -- 172.21.15.103:0/989295441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8670109170 msgr2=0x7f86701095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:41.380 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8670109170 0x7f86701095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.381 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 -- 172.21.15.103:0/989295441 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86701103c0 con 0x7f86700f94c0 2021-01-27T09:25:41.381 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866effd700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 0x7f8670107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:25:41.381 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866e7fc700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8658002a20 tx=0x7f8658009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:41.382 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658009320 con 0x7f86700f94c0 2021-01-27T09:25:41.382 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f865800f040 con 0x7f86700f94c0 2021-01-27T09:25:41.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670110550 con 0x7f86700f94c0 2021-01-27T09:25:41.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800d850 con 0x7f86700f94c0 2021-01-27T09:25:41.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.369+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8670110a10 con 0x7f86700f94c0 2021-01-27T09:25:41.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86700f6f30 con 0x7f86700f94c0 2021-01-27T09:25:41.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f8658009480 con 0x7f86700f94c0 2021-01-27T09:25:41.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f86677fe700 1 --2- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 0x7f865c05e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:41.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f86580758e0 con 0x7f86700f94c0 2021-01-27T09:25:41.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f866effd700 1 --2- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 0x7f865c05e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:41.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.373+0000 7f866effd700 1 --2- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 0x7f865c05e0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8660009fd0 tx=0x7f8660004c50).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:41.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.381+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f8658048550 con 0x7f86700f94c0 2021-01-27T09:25:41.546 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.541+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7f8670027100 con 0x7f86700f94c0 2021-01-27T09:25:41.565 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f86677fe700 1 -- 172.21.15.103:0/989295441 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v60) v1 ==== 98+0+11 (secure 0 0 0) 0x7f865804bb70 con 0x7f86700f94c0 2021-01-27T09:25:41.565 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 msgr2=0x7f865c05e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:41.565 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 0x7f865c05e0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8660009fd0 tx=0x7f8660004c50).stop 2021-01-27T09:25:41.566 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 msgr2=0x7f86701083c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:41.566 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8658002a20 tx=0x7f8658009de0).stop 2021-01-27T09:25:41.566 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 shutdown_connections 2021-01-27T09:25:41.566 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> v2:172.21.15.103:6800/3303543367 conn(0x7f865c05bbe0 0x7f865c05e0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8670109170 0x7f86701095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86700f83b0 0x7f8670107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 --2- 172.21.15.103:0/989295441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f86700f94c0 0x7f86701083c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 >> 172.21.15.103:0/989295441 conn(0x7f86700f3390 msgr2=0x7f86700fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 shutdown_connections 2021-01-27T09:25:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:41.545+0000 7f866ffff700 1 -- 172.21.15.103:0/989295441 wait complete. 2021-01-27T09:25:41.568 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2021-01-27T09:25:41.750 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:41 smithi103 bash[13570]: cluster 2021-01-27T09:25:40.241438+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:41.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:41 smithi103 bash[9772]: cluster 2021-01-27T09:25:40.241438+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:41 smithi047 bash[9721]: cluster 2021-01-27T09:25:40.241438+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:42.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-01-27T09:25:42.394 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:42.595 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:42 smithi103 bash[9772]: audit 2021-01-27T09:25:41.546325+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.103:0/989295441' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T09:25:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:42 smithi047 bash[9721]: audit 2021-01-27T09:25:41.546325+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.103:0/989295441' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T09:25:42.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:42 smithi103 bash[13570]: audit 2021-01-27T09:25:41.546325+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.103:0/989295441' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T09:25:43.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:43 smithi047 bash[9721]: cluster 2021-01-27T09:25:42.242071+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:43.807 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:43 smithi103 bash[13570]: cluster 2021-01-27T09:25:42.242071+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:43.808 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:43 smithi103 bash[9772]: cluster 2021-01-27T09:25:42.242071+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:44.146 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:43 smithi103 bash[10018]: debug 2021-01-27T09:25:43.929+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:44.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:43 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:44.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:44 smithi103 bash[9772]: audit 2021-01-27T09:25:43.931423+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:44.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:44 smithi103 bash[13570]: audit 2021-01-27T09:25:43.931423+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:44.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:44 smithi047 bash[9721]: audit 2021-01-27T09:25:43.931423+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 -- 172.21.15.103:0/1635292813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f3fe0 msgr2=0x7fdd500f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 --2- 172.21.15.103:0/1635292813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f3fe0 0x7fdd500f4460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdd48009e10 tx=0x7fdd48004c50).stop 2021-01-27T09:25:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 -- 172.21.15.103:0/1635292813 shutdown_connections 2021-01-27T09:25:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 --2- 172.21.15.103:0/1635292813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f3fe0 0x7fdd500f4460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 --2- 172.21.15.103:0/1635292813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f6ef0 0x7fdd500f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 --2- 172.21.15.103:0/1635292813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd500f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 -- 172.21.15.103:0/1635292813 >> 172.21.15.103:0/1635292813 conn(0x7fdd500ef730 msgr2=0x7fdd500f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 -- 172.21.15.103:0/1635292813 shutdown_connections 2021-01-27T09:25:45.532 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.524+0000 7fdd57003700 1 -- 172.21.15.103:0/1635292813 wait complete. 2021-01-27T09:25:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 Processor -- start 2021-01-27T09:25:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- start start 2021-01-27T09:25:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 0x7fdd501056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 0x7fdd50105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd50106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50106ff0 con 0x7fdd500f7890 2021-01-27T09:25:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50107160 con 0x7fdd500f3fe0 2021-01-27T09:25:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50107320 con 0x7fdd500f6ef0 2021-01-27T09:25:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd56001700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 0x7fdd501056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 0x7fdd50105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd56001700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 0x7fdd501056e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50080/0 (socket says 172.21.15.103:50080) 2021-01-27T09:25:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd56001700 1 -- 172.21.15.103:0/1252565494 learned_addr learned my addr 172.21.15.103:0/1252565494 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd56802700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd50106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 -- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 msgr2=0x7fdd501056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 0x7fdd501056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 -- 172.21.15.103:0/1252565494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 msgr2=0x7fdd50106ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd50106ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 -- 172.21.15.103:0/1252565494 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd501074e0 con 0x7fdd500f6ef0 2021-01-27T09:25:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd56802700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd50106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:25:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd55800700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 0x7fdd50105bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdd44002400 tx=0x7fdd44009cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x7fdd500f6ef0 2021-01-27T09:25:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fdd44009570 con 0x7fdd500f6ef0 2021-01-27T09:25:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd50107790 con 0x7fdd500f6ef0 2021-01-27T09:25:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4401d420 con 0x7fdd500f6ef0 2021-01-27T09:25:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.528+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd500f4db0 con 0x7fdd500f6ef0 2021-01-27T09:25:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fdd44009110 con 0x7fdd500f6ef0 2021-01-27T09:25:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd500f3320 con 0x7fdd500f6ef0 2021-01-27T09:25:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd427fc700 1 --2- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 0x7fdd3c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fdd4407e0e0 con 0x7fdd500f6ef0 2021-01-27T09:25:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd56001700 1 --2- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 0x7fdd3c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.532+0000 7fdd56001700 1 --2- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 0x7fdd3c05e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdd4c009fd0 tx=0x7fdd4c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.536+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fdd44050dd0 con 0x7fdd500f6ef0 2021-01-27T09:25:45.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:45 smithi103 bash[13570]: cluster 2021-01-27T09:25:44.243056+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:45.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:45 smithi103 bash[9772]: cluster 2021-01-27T09:25:44.243056+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:45.706 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.700+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"} v 0) v1 -- 0x7fdd50100670 con 0x7fdd500f6ef0 2021-01-27T09:25:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd427fc700 1 -- 172.21.15.103:0/1252565494 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]=0 v60) v1 ==== 94+0+10 (secure 0 0 0) 0x7fdd44009d30 con 0x7fdd500f6ef0 2021-01-27T09:25:45.707 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 3 2021-01-27T09:25:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 msgr2=0x7fdd3c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:45.709 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 0x7fdd3c05e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdd4c009fd0 tx=0x7fdd4c00b040).stop 2021-01-27T09:25:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 msgr2=0x7fdd50105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 0x7fdd50105bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdd44002400 tx=0x7fdd44009cc0).stop 2021-01-27T09:25:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 shutdown_connections 2021-01-27T09:25:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdd3c05bc70 0x7fdd3c05e130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.710 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd500f7890 0x7fdd50106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd500f3fe0 0x7fdd501056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 --2- 172.21.15.103:0/1252565494 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdd500f6ef0 0x7fdd50105bd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 >> 172.21.15.103:0/1252565494 conn(0x7fdd500ef730 msgr2=0x7fdd500f1540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:45.711 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 shutdown_connections 2021-01-27T09:25:45.712 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:45.704+0000 7fdd57003700 1 -- 172.21.15.103:0/1252565494 wait complete. 2021-01-27T09:25:45.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:45 smithi047 bash[9721]: cluster 2021-01-27T09:25:44.243056+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:46.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2021-01-27T09:25:46.429 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:46 smithi047 systemd[1]: Started Ceph grafana.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:46.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[9772]: audit 2021-01-27T09:25:45.705879+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.103:0/1252565494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T09:25:46.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[9772]: audit 2021-01-27T09:25:46.369494+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:46.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[9772]: audit 2021-01-27T09:25:46.372732+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:46.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[9772]: audit 2021-01-27T09:25:46.373167+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:46.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[13570]: audit 2021-01-27T09:25:45.705879+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.103:0/1252565494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T09:25:46.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[13570]: audit 2021-01-27T09:25:46.369494+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:46.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[13570]: audit 2021-01-27T09:25:46.372732+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:46.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:46 smithi103 bash[13570]: audit 2021-01-27T09:25:46.373167+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:46.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:46 smithi047 bash[9721]: audit 2021-01-27T09:25:45.705879+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.103:0/1252565494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T09:25:46.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:46 smithi047 bash[9721]: audit 2021-01-27T09:25:46.369494+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:46.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:46 smithi047 bash[9721]: audit 2021-01-27T09:25:46.372732+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:46.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:46 smithi047 bash[9721]: audit 2021-01-27T09:25:46.373167+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:25:47.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[9721]: cluster 2021-01-27T09:25:46.244191+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:47.803 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-01-27T09:25:47.803 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-01-27T09:25:47.803 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-01-27T09:25:47.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-01-27T09:25:47.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-01-27T09:25:47.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-01-27T09:25:47.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-01-27T09:25:47.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-01-27T09:25:47.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-01-27T09:25:47.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-01-27T09:25:47.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-01-27T09:25:47.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-01-27T09:25:47.806 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="App mode production" logger=settings 2021-01-27T09:25:47.806 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-01-27T09:25:47.806 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-01-27T09:25:47.806 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-01-27T09:25:47.806 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-01-27T09:25:47.864 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:47 smithi103 bash[9772]: cluster 2021-01-27T09:25:46.244191+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:47.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:47 smithi103 bash[13570]: cluster 2021-01-27T09:25:46.244191+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:48.107 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-01-27T09:25:48.107 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-01-27T09:25:48.107 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:47 smithi047 bash[24552]: t=2021-01-27T09:25:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-01-27T09:25:48.392 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-01-27T09:25:48.393 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-01-27T09:25:48.393 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-01-27T09:25:48.393 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-01-27T09:25:48.393 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-01-27T09:25:48.669 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-01-27T09:25:48.669 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T09:25:48.669 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-01-27T09:25:48.946 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-01-27T09:25:48.946 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-01-27T09:25:48.947 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-01-27T09:25:48.947 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-01-27T09:25:48.947 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-01-27T09:25:48.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[9721]: audit 2021-01-27T09:25:47.899522+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:48.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[9721]: audit 2021-01-27T09:25:48.527607+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:49.206 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:48 smithi047 bash[24552]: t=2021-01-27T09:25:48+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-01-27T09:25:49.206 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-01-27T09:25:49.207 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-01-27T09:25:49.207 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-01-27T09:25:49.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:48 smithi103 bash[9772]: audit 2021-01-27T09:25:47.899522+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:49.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:48 smithi103 bash[9772]: audit 2021-01-27T09:25:48.527607+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:49.338 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:48 smithi103 bash[13570]: audit 2021-01-27T09:25:47.899522+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:49.338 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:48 smithi103 bash[13570]: audit 2021-01-27T09:25:48.527607+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:49.500 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-01-27T09:25:49.500 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-01-27T09:25:49.500 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-01-27T09:25:49.500 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-01-27T09:25:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- 172.21.15.103:0/1406325550 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f7800 msgr2=0x7f0b440f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- 172.21.15.103:0/1406325550 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f7800 0x7f0b440f3a10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b2c004e00 tx=0x7f0b2c009b30).stop 2021-01-27T09:25:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- 172.21.15.103:0/1406325550 shutdown_connections 2021-01-27T09:25:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- 172.21.15.103:0/1406325550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f3fe0 0x7f0b440f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- 172.21.15.103:0/1406325550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f6ef0 0x7f0b440f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- 172.21.15.103:0/1406325550 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f7800 0x7f0b440f3a10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- 172.21.15.103:0/1406325550 >> 172.21.15.103:0/1406325550 conn(0x7f0b440ef730 msgr2=0x7f0b440f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- 172.21.15.103:0/1406325550 shutdown_connections 2021-01-27T09:25:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- 172.21.15.103:0/1406325550 wait complete. 2021-01-27T09:25:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 Processor -- start 2021-01-27T09:25:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- start start 2021-01-27T09:25:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f3fe0 0x7f0b441058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 0x7f0b44105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441071f0 con 0x7f0b440f6ef0 2021-01-27T09:25:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b44107360 con 0x7f0b440f7800 2021-01-27T09:25:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b4949b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b44107520 con 0x7f0b440f3fe0 2021-01-27T09:25:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b48c9a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b48c9a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50098/0 (socket says 172.21.15.103:50098) 2021-01-27T09:25:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b48c9a700 1 -- 172.21.15.103:0/4262277192 learned_addr learned my addr 172.21.15.103:0/4262277192 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.544+0000 7f0b43fff700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f3fe0 0x7f0b441058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b3bfff700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 0x7f0b44105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 -- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f3fe0 msgr2=0x7f0b441058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f3fe0 0x7f0b441058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 -- 172.21.15.103:0/4262277192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 msgr2=0x7f0b44105dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 0x7f0b44105dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 -- 172.21.15.103:0/4262277192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b441076e0 con 0x7f0b440f7800 2021-01-27T09:25:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b3bfff700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 0x7f0b44105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:25:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b48c9a700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0b3c00db40 tx=0x7f0b3c004e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c004020 con 0x7f0b440f7800 2021-01-27T09:25:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0b3c00f040 con 0x7f0b440f7800 2021-01-27T09:25:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b44107990 con 0x7f0b440f7800 2021-01-27T09:25:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c003740 con 0x7f0b440f7800 2021-01-27T09:25:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b440f4db0 con 0x7f0b440f7800 2021-01-27T09:25:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b440f33c0 con 0x7f0b440f7800 2021-01-27T09:25:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.548+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f0b3c003b70 con 0x7f0b440f7800 2021-01-27T09:25:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.552+0000 7f0b417fa700 1 --2- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 0x7f0b3005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.552+0000 7f0b43fff700 1 --2- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 0x7f0b3005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.552+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f0b3c0758c0 con 0x7f0b440f7800 2021-01-27T09:25:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.552+0000 7f0b43fff700 1 --2- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 0x7f0b3005e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0b34009fd0 tx=0x7f0b3400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.556+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f0b3c0458c0 con 0x7f0b440f7800 2021-01-27T09:25:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.724+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7f0b44044bc0 con 0x7f0b440f7800 2021-01-27T09:25:49.730 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.724+0000 7f0b417fa700 1 -- 172.21.15.103:0/4262277192 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]=0 v60) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0b3c0484a0 con 0x7f0b440f7800 2021-01-27T09:25:49.730 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2021-01-27T09:25:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 msgr2=0x7f0b3005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 0x7f0b3005e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0b34009fd0 tx=0x7f0b3400b040).stop 2021-01-27T09:25:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 msgr2=0x7f0b44106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0b3c00db40 tx=0x7f0b3c004e40).stop 2021-01-27T09:25:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 shutdown_connections 2021-01-27T09:25:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0b3005bc70 0x7f0b3005e130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b440f7800 0x7f0b44106cc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b440f3fe0 0x7f0b441058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 --2- 172.21.15.103:0/4262277192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b440f6ef0 0x7f0b44105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 >> 172.21.15.103:0/4262277192 conn(0x7f0b440ef730 msgr2=0x7f0b440f17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 shutdown_connections 2021-01-27T09:25:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:49.728+0000 7f0b4949b700 1 -- 172.21.15.103:0/4262277192 wait complete. 2021-01-27T09:25:49.751 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-01-27T09:25:49.751 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-01-27T09:25:49.751 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-01-27T09:25:50.011 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-01-27T09:25:50.011 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-01-27T09:25:50.011 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[24552]: t=2021-01-27T09:25:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-01-27T09:25:50.012 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cluster 2021-01-27T09:25:48.245124+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:50.012 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.528819+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:25:50.012 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: audit 2021-01-27T09:25:48.955854+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:50.012 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.958151+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:50.013 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.959798+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:50.013 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.960919+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:50.013 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.962320+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.013 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.963090+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:50.014 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.963792+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.014 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.964488+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.014 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.966448+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T09:25:50.014 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: cephadm 2021-01-27T09:25:48.969662+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi103 2021-01-27T09:25:50.014 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:49 smithi047 bash[9721]: audit 2021-01-27T09:25:49.728277+0000 mon.a (mon.0) 631 : audit [DBG] from='client.? 172.21.15.103:0/4262277192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T09:25:50.073 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cluster 2021-01-27T09:25:48.245124+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:50.073 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.528819+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:25:50.073 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: audit 2021-01-27T09:25:48.955854+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:50.074 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.958151+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:50.074 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.959798+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:50.074 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.960919+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:50.074 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.962320+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.074 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.963090+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:50.075 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.963792+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.075 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.964488+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.075 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.966448+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T09:25:50.076 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: cephadm 2021-01-27T09:25:48.969662+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi103 2021-01-27T09:25:50.076 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[13570]: audit 2021-01-27T09:25:49.728277+0000 mon.a (mon.0) 631 : audit [DBG] from='client.? 172.21.15.103:0/4262277192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T09:25:50.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cluster 2021-01-27T09:25:48.245124+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:50.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.528819+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi047 facts 2021-01-27T09:25:50.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: audit 2021-01-27T09:25:48.955854+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:50.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.958151+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:25:50.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.959798+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:25:50.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.960919+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:25:50.078 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.962320+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.078 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.963090+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:25:50.078 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.963792+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.078 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.964488+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:25:50.078 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.966448+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T09:25:50.079 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: cephadm 2021-01-27T09:25:48.969662+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi103 2021-01-27T09:25:50.079 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:49 smithi103 bash[9772]: audit 2021-01-27T09:25:49.728277+0000 mon.a (mon.0) 631 : audit [DBG] from='client.? 172.21.15.103:0/4262277192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T09:25:50.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-01-27T09:25:50.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-01-27T09:25:50.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-01-27T09:25:50.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-01-27T09:25:50.673 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-01-27T09:25:50.673 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-01-27T09:25:50.673 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-01-27T09:25:50.673 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-01-27T09:25:50.674 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-01-27T09:25:50.941 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2021-01-27T09:25:51.018 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-01-27T09:25:51.019 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-01-27T09:25:51.019 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:50 smithi047 bash[24552]: t=2021-01-27T09:25:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-01-27T09:25:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:51.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-01-27T09:25:51.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-01-27T09:25:51.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-01-27T09:25:51.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-01-27T09:25:51.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-01-27T09:25:51.595 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-01-27T09:25:51.595 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-01-27T09:25:51.595 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-01-27T09:25:51.595 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-01-27T09:25:51.596 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-01-27T09:25:51.855 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-01-27T09:25:51.855 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-01-27T09:25:51.855 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-01-27T09:25:51.855 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-01-27T09:25:51.856 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-01-27T09:25:52.156 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[9721]: cluster 2021-01-27T09:25:50.246539+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:52.157 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:51 smithi047 bash[24552]: t=2021-01-27T09:25:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-01-27T09:25:52.157 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-01-27T09:25:52.157 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-01-27T09:25:52.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:51 smithi103 bash[9772]: cluster 2021-01-27T09:25:50.246539+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:52.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:51 smithi103 bash[13570]: cluster 2021-01-27T09:25:50.246539+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:52.424 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-01-27T09:25:52.425 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-01-27T09:25:52.425 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-01-27T09:25:52.676 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-01-27T09:25:52.676 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-01-27T09:25:52.677 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-01-27T09:25:52.677 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-01-27T09:25:52.944 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-01-27T09:25:52.945 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-01-27T09:25:52.945 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-01-27T09:25:52.945 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-01-27T09:25:53.221 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:52 smithi047 bash[24552]: t=2021-01-27T09:25:52+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-01-27T09:25:53.221 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-01-27T09:25:53.221 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-01-27T09:25:53.222 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-01-27T09:25:53.222 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-01-27T09:25:53.497 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-01-27T09:25:53.498 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-01-27T09:25:53.498 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-01-27T09:25:53.749 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-01-27T09:25:53.749 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T09:25:53.749 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-01-27T09:25:54.034 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:25:53 smithi103 bash[10018]: debug 2021-01-27T09:25:53.940+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:25:54.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[9721]: cluster 2021-01-27T09:25:52.247453+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:54.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:25:54.051 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-01-27T09:25:54.051 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-01-27T09:25:54.051 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-01-27T09:25:54.052 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:53 smithi047 bash[24552]: t=2021-01-27T09:25:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-01-27T09:25:54.303 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-01-27T09:25:54.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-01-27T09:25:54.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-01-27T09:25:54.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-01-27T09:25:54.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:54 smithi103 bash[13570]: cluster 2021-01-27T09:25:52.247453+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:54.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:54 smithi103 bash[9772]: cluster 2021-01-27T09:25:52.247453+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:54.604 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-01-27T09:25:54.604 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-01-27T09:25:54.604 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-01-27T09:25:54.605 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-01-27T09:25:54.905 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-01-27T09:25:54.905 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-01-27T09:25:54.906 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-01-27T09:25:54.906 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-01-27T09:25:54.906 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-01-27T09:25:55.191 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[9721]: audit 2021-01-27T09:25:53.943153+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:55.191 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:54 smithi047 bash[24552]: t=2021-01-27T09:25:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-01-27T09:25:55.191 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-01-27T09:25:55.191 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-01-27T09:25:55.192 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-01-27T09:25:55.229 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:54 smithi103 bash[13570]: audit 2021-01-27T09:25:53.943153+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:55.230 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:54 smithi103 bash[9772]: audit 2021-01-27T09:25:53.943153+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:25:55.509 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-01-27T09:25:55.509 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-01-27T09:25:55.509 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-01-27T09:25:55.785 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-01-27T09:25:55.786 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-01-27T09:25:55.786 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-01-27T09:25:55.786 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-01-27T09:25:55.787 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-01-27T09:25:56.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[9721]: cluster 2021-01-27T09:25:54.248543+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:56.054 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-01-27T09:25:56.055 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-01-27T09:25:56.055 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:55 smithi047 bash[24552]: t=2021-01-27T09:25:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-01-27T09:25:56.056 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-01-27T09:25:56.239 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:55 smithi103 bash[13570]: cluster 2021-01-27T09:25:54.248543+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:56.240 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:56 smithi103 systemd[1]: Stopping Ceph alertmanager.a for 78337516-6080-11eb-8f9a-001a4aab830c... 2021-01-27T09:25:56.240 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:56 smithi103 bash[26733]: level=info ts=2021-01-27T09:25:56.210Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T09:25:56.240 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:55 smithi103 bash[9772]: cluster 2021-01-27T09:25:54.248543+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:25:56.331 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-01-27T09:25:56.331 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-01-27T09:25:56.332 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-01-27T09:25:56.332 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-01-27T09:25:56.374 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- 172.21.15.103:0/2450753430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc405f630 msgr2=0x7f5cc40f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:56.375 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/2450753430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc405f630 0x7f5cc40f8520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5cb4004e00 tx=0x7f5cb4009b30).stop 2021-01-27T09:25:56.375 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- 172.21.15.103:0/2450753430 shutdown_connections 2021-01-27T09:25:56.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/2450753430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40fb4a0 0x7f5cc40fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.376 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/2450753430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc405f630 0x7f5cc40f8520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.377 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/2450753430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc40f8a10 0x7f5cc40fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.377 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- 172.21.15.103:0/2450753430 >> 172.21.15.103:0/2450753430 conn(0x7f5cc40effa0 msgr2=0x7f5cc40f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:56.377 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- 172.21.15.103:0/2450753430 shutdown_connections 2021-01-27T09:25:56.378 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- 172.21.15.103:0/2450753430 wait complete. 2021-01-27T09:25:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 Processor -- start 2021-01-27T09:25:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- start start 2021-01-27T09:25:56.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:56.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40f8a10 0x7f5cc40f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:56.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc40fb4a0 0x7f5cc40f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:56.384 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40f5160 con 0x7f5cc40f8a10 2021-01-27T09:25:56.384 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40f52d0 con 0x7f5cc40fb4a0 2021-01-27T09:25:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.368+0000 7f5cc88ea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc410f960 con 0x7f5cc405f630 2021-01-27T09:25:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc359e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc40fb4a0 0x7f5cc40f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:56.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32866/0 (socket says 172.21.15.103:32866) 2021-01-27T09:25:56.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 -- 172.21.15.103:0/1110803743 learned_addr learned my addr 172.21.15.103:0/1110803743 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:25:56.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc259c700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40f8a10 0x7f5cc40f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:56.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 -- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc40fb4a0 msgr2=0x7f5cc40f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:56.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc40fb4a0 0x7f5cc40f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 -- 172.21.15.103:0/1110803743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40f8a10 msgr2=0x7f5cc40f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:56.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40f8a10 0x7f5cc40f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 -- 172.21.15.103:0/1110803743 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc410fb20 con 0x7f5cc405f630 2021-01-27T09:25:56.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc2d9d700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5cb400b740 tx=0x7f5cb4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:56.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb400e030 con 0x7f5cc405f630 2021-01-27T09:25:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5cb4004290 con 0x7f5cc405f630 2021-01-27T09:25:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc410fd70 con 0x7f5cc405f630 2021-01-27T09:25:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4018070 con 0x7f5cc405f630 2021-01-27T09:25:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4110120 con 0x7f5cc405f630 2021-01-27T09:25:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc40f3b90 con 0x7f5cc405f630 2021-01-27T09:25:56.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.372+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f5cb401d420 con 0x7f5cc405f630 2021-01-27T09:25:56.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.376+0000 7f5cab7fe700 1 --2- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 0x7f5cac05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:25:56.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.376+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f5cb4077800 con 0x7f5cc405f630 2021-01-27T09:25:56.393 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.376+0000 7f5cc259c700 1 --2- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 0x7f5cac05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:25:56.393 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.376+0000 7f5cc259c700 1 --2- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 0x7f5cac05e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5cb8009fd0 tx=0x7f5cb800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:25:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.380+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f5cb404a470 con 0x7f5cc405f630 2021-01-27T09:25:56.552 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.548+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7f5cc40f3b90 con 0x7f5cc405f630 2021-01-27T09:25:56.553 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.548+0000 7f5cab7fe700 1 -- 172.21.15.103:0/1110803743 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]=0 v60) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5cb404da90 con 0x7f5cc405f630 2021-01-27T09:25:56.553 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2021-01-27T09:25:56.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 msgr2=0x7f5cac05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:56.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 0x7f5cac05e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5cb8009fd0 tx=0x7f5cb800b040).stop 2021-01-27T09:25:56.557 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 msgr2=0x7f5cc40f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:25:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5cb400b740 tx=0x7f5cb4009b30).stop 2021-01-27T09:25:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 shutdown_connections 2021-01-27T09:25:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> v2:172.21.15.103:6800/3303543367 conn(0x7f5cac05bc70 0x7f5cac05e130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cc40fb4a0 0x7f5cc40f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cc405f630 0x7f5cc40f5fa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 --2- 172.21.15.103:0/1110803743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cc40f8a10 0x7f5cc40f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:25:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 >> 172.21.15.103:0/1110803743 conn(0x7f5cc40effa0 msgr2=0x7f5cc40f6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:25:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 shutdown_connections 2021-01-27T09:25:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:25:56.552+0000 7f5cc88ea700 1 -- 172.21.15.103:0/1110803743 wait complete. 2021-01-27T09:25:56.603 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-01-27T09:25:56.603 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-01-27T09:25:56.603 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-01-27T09:25:56.603 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-01-27T09:25:56.870 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-01-27T09:25:56.871 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-01-27T09:25:56.871 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-01-27T09:25:56.871 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-01-27T09:25:57.143 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[9721]: audit 2021-01-27T09:25:56.551328+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.103:0/1110803743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T09:25:57.144 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:56 smithi047 bash[24552]: t=2021-01-27T09:25:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-01-27T09:25:57.144 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-01-27T09:25:57.144 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-01-27T09:25:57.144 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-01-27T09:25:57.337 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:56 smithi103 bash[13570]: audit 2021-01-27T09:25:56.551328+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.103:0/1110803743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T09:25:57.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:56 smithi103 bash[9772]: audit 2021-01-27T09:25:56.551328+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.103:0/1110803743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T09:25:57.459 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-01-27T09:25:57.459 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-01-27T09:25:57.459 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-01-27T09:25:57.647 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:57 smithi103 docker[28343]: ceph-78337516-6080-11eb-8f9a-001a4aab830c-alertmanager.a 2021-01-27T09:25:57.647 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:57 smithi103 systemd[1]: ceph-78337516-6080-11eb-8f9a-001a4aab830c@alertmanager.a.service: Succeeded. 2021-01-27T09:25:57.647 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:57 smithi103 systemd[1]: Stopped Ceph alertmanager.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:57.647 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:57 smithi103 systemd[1]: Started Ceph alertmanager.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:25:57.713 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-01-27T09:25:57.714 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-01-27T09:25:57.714 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-01-27T09:25:57.714 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-01-27T09:25:57.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2021-01-27T09:25:57.960 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:25:57.994 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-01-27T09:25:57.995 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-01-27T09:25:57.995 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[24552]: t=2021-01-27T09:25:57+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-01-27T09:25:58.124 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[9721]: cluster 2021-01-27T09:25:56.249374+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:58.125 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:57 smithi047 bash[9721]: audit 2021-01-27T09:25:57.444547+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:57 smithi103 bash[9772]: cluster 2021-01-27T09:25:56.249374+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:58.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:57 smithi103 bash[9772]: audit 2021-01-27T09:25:57.444547+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:58.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:57 smithi103 bash[13570]: cluster 2021-01-27T09:25:56.249374+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:25:58.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:57 smithi103 bash[13570]: audit 2021-01-27T09:25:57.444547+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:25:58.274 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:58 smithi047 bash[24552]: t=2021-01-27T09:25:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-01-27T09:25:58.553 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:58 smithi047 bash[24552]: t=2021-01-27T09:25:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-01-27T09:25:59.054 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:58 smithi047 bash[24552]: t=2021-01-27T09:25:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-01-27T09:25:59.054 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:58 smithi047 bash[24552]: t=2021-01-27T09:25:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-01-27T09:25:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[9721]: cephadm 2021-01-27T09:25:57.446466+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T09:25:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[9721]: cephadm 2021-01-27T09:25:57.451291+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi047 2021-01-27T09:25:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[9721]: audit 2021-01-27T09:25:58.336985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:25:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[9721]: audit 2021-01-27T09:25:58.340406+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:25:59.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[13570]: cephadm 2021-01-27T09:25:57.446466+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T09:25:59.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[13570]: cephadm 2021-01-27T09:25:57.451291+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi047 2021-01-27T09:25:59.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[13570]: audit 2021-01-27T09:25:58.336985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:25:59.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[13570]: audit 2021-01-27T09:25:58.340406+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:25:59.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[9772]: cephadm 2021-01-27T09:25:57.446466+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T09:25:59.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[9772]: cephadm 2021-01-27T09:25:57.451291+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi047 2021-01-27T09:25:59.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[9772]: audit 2021-01-27T09:25:58.336985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:25:59.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[9772]: audit 2021-01-27T09:25:58.340406+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:25:59.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[24552]: t=2021-01-27T09:25:59+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-01-27T09:25:59.787 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.614Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T09:25:59.787 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.614Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T09:25:59.788 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.617Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.103 port=9094 2021-01-27T09:25:59.788 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.618Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T09:25:59.788 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.666Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T09:25:59.788 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.666Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T09:25:59.788 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:25:59 smithi103 bash[28456]: level=info ts=2021-01-27T09:25:59.670Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T09:25:59.894 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[24552]: t=2021-01-27T09:25:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-01-27T09:25:59.895 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[24552]: t=2021-01-27T09:25:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-01-27T09:26:00.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:00 smithi103 bash[9772]: cluster 2021-01-27T09:25:58.250297+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:00.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:00 smithi103 bash[13570]: cluster 2021-01-27T09:25:58.250297+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:00.215 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[9721]: cluster 2021-01-27T09:25:58.250297+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:00.216 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:25:59 smithi047 bash[24552]: t=2021-01-27T09:25:59+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-01-27T09:26:00.216 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-01-27T09:26:00.216 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-01-27T09:26:00.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-01-27T09:26:00.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-01-27T09:26:00.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-01-27T09:26:01.061 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:00 smithi047 bash[24552]: t=2021-01-27T09:26:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-01-27T09:26:01.501 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:01 smithi047 bash[24552]: t=2021-01-27T09:26:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-01-27T09:26:01.502 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:01 smithi047 bash[24552]: t=2021-01-27T09:26:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-01-27T09:26:01.693 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/3655652665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 msgr2=0x7fdbf00fae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/3655652665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf00fae60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdbe4004e00 tx=0x7fdbe4009b30).stop 2021-01-27T09:26:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/3655652665 shutdown_connections 2021-01-27T09:26:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/3655652665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 0x7fdbf00fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/3655652665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 0x7fdbf00f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/3655652665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf00fae60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/3655652665 >> 172.21.15.103:0/3655652665 conn(0x7fdbf00effa0 msgr2=0x7fdbf00f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/3655652665 shutdown_connections 2021-01-27T09:26:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/3655652665 wait complete. 2021-01-27T09:26:01.697 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 Processor -- start 2021-01-27T09:26:01.698 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- start start 2021-01-27T09:26:01.698 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 0x7fdbf0105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:01.698 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:01.698 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 0x7fdbf0106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:01.699 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0107220 con 0x7fdbf005f710 2021-01-27T09:26:01.699 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0107390 con 0x7fdbf00fb4a0 2021-01-27T09:26:01.699 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf6f8f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0107550 con 0x7fdbf00f8a30 2021-01-27T09:26:01.699 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:01.700 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32882/0 (socket says 172.21.15.103:32882) 2021-01-27T09:26:01.700 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 -- 172.21.15.103:0/556727028 learned_addr learned my addr 172.21.15.103:0/556727028 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:01.700 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf5f8d700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 0x7fdbf0105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:01.700 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf678e700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 0x7fdbf0106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:01.701 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 -- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 msgr2=0x7fdbf0106cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:01.701 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 0x7fdbf0106cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.701 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 -- 172.21.15.103:0/556727028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 msgr2=0x7fdbf0105910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:01.701 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 0x7fdbf0105910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.702 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 -- 172.21.15.103:0/556727028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0107710 con 0x7fdbf00f8a30 2021-01-27T09:26:01.702 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.687+0000 7fdbf578c700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdbe4004ca0 tx=0x7fdbe4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:01.702 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400e030 con 0x7fdbf00f8a30 2021-01-27T09:26:01.702 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fdbe4004160 con 0x7fdbf00f8a30 2021-01-27T09:26:01.702 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0107960 con 0x7fdbf00f8a30 2021-01-27T09:26:01.703 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4018070 con 0x7fdbf00f8a30 2021-01-27T09:26:01.703 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf010e100 con 0x7fdbf00f8a30 2021-01-27T09:26:01.704 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf00f3b90 con 0x7fdbf00f8a30 2021-01-27T09:26:01.704 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fdbe4013b80 con 0x7fdbf00f8a30 2021-01-27T09:26:01.704 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 --2- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 0x7fdbd805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:01.705 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fdbe40777a0 con 0x7fdbf00f8a30 2021-01-27T09:26:01.706 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.691+0000 7fdbf5f8d700 1 --2- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 0x7fdbd805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:01.706 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.695+0000 7fdbf5f8d700 1 --2- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 0x7fdbd805e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdbe8004fd0 tx=0x7fdbe800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:01.707 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.699+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fdbe404a490 con 0x7fdbf00f8a30 2021-01-27T09:26:01.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:01 smithi047 bash[24552]: t=2021-01-27T09:26:01+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-01-27T09:26:01.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:01 smithi047 bash[24552]: t=2021-01-27T09:26:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-01-27T09:26:01.873 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.867+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7fdbf0044bc0 con 0x7fdbf00f8a30 2021-01-27T09:26:01.874 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.867+0000 7fdbee7fc700 1 -- 172.21.15.103:0/556727028 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]=0 v60) v1 ==== 102+0+11 (secure 0 0 0) 0x7fdbe4075e60 con 0x7fdbf00f8a30 2021-01-27T09:26:01.874 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2021-01-27T09:26:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 msgr2=0x7fdbd805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 0x7fdbd805e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdbe8004fd0 tx=0x7fdbe800b040).stop 2021-01-27T09:26:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 msgr2=0x7fdbf0105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdbe4004ca0 tx=0x7fdbe4009b30).stop 2021-01-27T09:26:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 shutdown_connections 2021-01-27T09:26:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> v2:172.21.15.103:6800/3303543367 conn(0x7fdbd805bc70 0x7fdbd805e130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbf00fb4a0 0x7fdbf0106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbf005f710 0x7fdbf0105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 --2- 172.21.15.103:0/556727028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbf00f8a30 0x7fdbf0105e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 >> 172.21.15.103:0/556727028 conn(0x7fdbf00effa0 msgr2=0x7fdbf00fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 shutdown_connections 2021-01-27T09:26:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:01.871+0000 7fdbf6f8f700 1 -- 172.21.15.103:0/556727028 wait complete. 2021-01-27T09:26:01.897 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:26:01 smithi103 bash[28456]: level=info ts=2021-01-27T09:26:01.619Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000148046s 2021-01-27T09:26:02.230 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:01 smithi047 bash[24552]: t=2021-01-27T09:26:01+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-01-27T09:26:02.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:02 smithi047 bash[9721]: cluster 2021-01-27T09:26:00.251651+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:02.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:02 smithi047 bash[9721]: audit 2021-01-27T09:26:01.871642+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.103:0/556727028' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T09:26:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:02 smithi103 bash[9772]: cluster 2021-01-27T09:26:00.251651+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:02 smithi103 bash[9772]: audit 2021-01-27T09:26:01.871642+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.103:0/556727028' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T09:26:02.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:02 smithi103 bash[13570]: cluster 2021-01-27T09:26:00.251651+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:02 smithi103 bash[13570]: audit 2021-01-27T09:26:01.871642+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.103:0/556727028' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T09:26:02.536 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:02 smithi047 bash[24552]: t=2021-01-27T09:26:02+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-01-27T09:26:02.536 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:02 smithi047 bash[24552]: t=2021-01-27T09:26:02+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-01-27T09:26:02.609 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-27T09:26:02.610 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-01-27T09:26:02.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph mgr dump --format=json 2021-01-27T09:26:02.765 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:02.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:02 smithi047 bash[24552]: t=2021-01-27T09:26:02+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-01-27T09:26:03.288 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-01-27T09:26:03.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-01-27T09:26:03.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-01-27T09:26:03.858 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-01-27T09:26:03.858 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-01-27T09:26:04.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:04 smithi103 bash[9772]: cluster 2021-01-27T09:26:02.252527+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:04.022 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:03 smithi103 bash[10018]: debug 2021-01-27T09:26:03.947+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:04.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:04 smithi047 bash[9721]: cluster 2021-01-27T09:26:02.252527+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:04.194 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:04.194 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-01-27T09:26:04.195 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:03 smithi047 bash[24552]: t=2021-01-27T09:26:03+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-01-27T09:26:04.195 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:04 smithi047 bash[24552]: t=2021-01-27T09:26:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-01-27T09:26:04.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:04 smithi103 bash[13570]: cluster 2021-01-27T09:26:02.252527+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:04.596 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:04 smithi047 bash[24552]: t=2021-01-27T09:26:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-01-27T09:26:04.597 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:04 smithi047 bash[24552]: t=2021-01-27T09:26:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-01-27T09:26:05.212 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[9721]: audit 2021-01-27T09:26:03.951967+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:05.213 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:04 smithi047 bash[24552]: t=2021-01-27T09:26:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-01-27T09:26:05.213 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-01-27T09:26:05.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:05 smithi103 bash[9772]: audit 2021-01-27T09:26:03.951967+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:05.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:05 smithi103 bash[13570]: audit 2021-01-27T09:26:03.951967+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:05.514 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-01-27T09:26:05.515 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-01-27T09:26:05.515 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-01-27T09:26:05.515 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 systemd[1]: Stopping Ceph prometheus.a for 78337516-6080-11eb-8f9a-001a4aab830c... 2021-01-27T09:26:05.646 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- 172.21.15.103:0/409271402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f67e0 msgr2=0x7f95f80f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:05.646 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- 172.21.15.103:0/409271402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f67e0 0x7f95f80f8c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f95e8004e00 tx=0x7f95e8009b30).stop 2021-01-27T09:26:05.646 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- 172.21.15.103:0/409271402 shutdown_connections 2021-01-27T09:26:05.646 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- 172.21.15.103:0/409271402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f80f9290 0x7f95f80f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.647 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- 172.21.15.103:0/409271402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f805f770 0x7f95f80f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.647 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- 172.21.15.103:0/409271402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f67e0 0x7f95f80f8c70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.647 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- 172.21.15.103:0/409271402 >> 172.21.15.103:0/409271402 conn(0x7f95f80eff70 msgr2=0x7f95f80f23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:05.647 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- 172.21.15.103:0/409271402 shutdown_connections 2021-01-27T09:26:05.647 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- 172.21.15.103:0/409271402 wait complete. 2021-01-27T09:26:05.649 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 Processor -- start 2021-01-27T09:26:05.649 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- start start 2021-01-27T09:26:05.650 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:05.650 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f80f67e0 0x7f95f810c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:05.650 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 0x7f95f810d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:05.650 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f810d830 con 0x7f95f80f67e0 2021-01-27T09:26:05.651 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f810d9a0 con 0x7f95f80f9290 2021-01-27T09:26:05.651 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f759e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f810db60 con 0x7f95f805f770 2021-01-27T09:26:05.651 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f659c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:05.651 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f659c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32894/0 (socket says 172.21.15.103:32894) 2021-01-27T09:26:05.651 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f659c700 1 -- 172.21.15.103:0/2232934242 learned_addr learned my addr 172.21.15.103:0/2232934242 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:05.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f5d9b700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f80f67e0 0x7f95f810c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:05.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.639+0000 7f95f6d9d700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 0x7f95f810d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:05.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 -- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 msgr2=0x7f95f810d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:05.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 0x7f95f810d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 -- 172.21.15.103:0/2232934242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f80f67e0 msgr2=0x7f95f810c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:05.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f80f67e0 0x7f95f810c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 -- 172.21.15.103:0/2232934242 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f810dd20 con 0x7f95f805f770 2021-01-27T09:26:05.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f6d9d700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 0x7f95f810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:05.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f659c700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f95f000de20 tx=0x7f95f0004ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:05.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007e40 con 0x7f95f805f770 2021-01-27T09:26:05.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f95f000f040 con 0x7f95f805f770 2021-01-27T09:26:05.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f810dfd0 con 0x7f95f805f770 2021-01-27T09:26:05.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0013cd0 con 0x7f95f805f770 2021-01-27T09:26:05.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f8114760 con 0x7f95f805f770 2021-01-27T09:26:05.656 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f80f3b80 con 0x7f95f805f770 2021-01-27T09:26:05.656 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f95f001a030 con 0x7f95f805f770 2021-01-27T09:26:05.656 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 --2- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 0x7f95d805e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:05.656 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.643+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f95f0075590 con 0x7f95f805f770 2021-01-27T09:26:05.657 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.647+0000 7f95f5d9b700 1 --2- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 0x7f95d805e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:05.657 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.647+0000 7f95f5d9b700 1 --2- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 0x7f95d805e170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f95e8009c20 tx=0x7f95e8009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:05.659 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.651+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f95f00468c0 con 0x7f95f805f770 2021-01-27T09:26:05.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-01-27T09:26:05.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-01-27T09:26:05.805 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=warn ts=2021-01-27T09:26:05.510Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T09:26:05.805 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-01-27T09:26:05.805 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-01-27T09:26:05.806 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:583 msg="Stopping scrape manager..." 2021-01-27T09:26:05.806 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-01-27T09:26:05.806 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-01-27T09:26:05.806 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-01-27T09:26:05.807 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-01-27T09:26:05.807 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:577 msg="Scrape manager stopped" 2021-01-27T09:26:05.807 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-01-27T09:26:05.807 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.510Z caller=main.go:749 msg="Notifier manager stopped" 2021-01-27T09:26:05.807 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[23146]: level=info ts=2021-01-27T09:26:05.511Z caller=main.go:761 msg="See you next time!" 2021-01-27T09:26:05.856 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.847+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f95f8044bc0 con 0x7f95f805f770 2021-01-27T09:26:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.851+0000 7f95eeffd700 1 -- 172.21.15.103:0/2232934242 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v15) v1 ==== 74+0+142229 (secure 0 0 0) 0x7f95f0044bb0 con 0x7f95f805f770 2021-01-27T09:26:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:26:05.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 msgr2=0x7f95d805e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:05.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 0x7f95d805e170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f95e8009c20 tx=0x7f95e8009b30).stop 2021-01-27T09:26:05.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 msgr2=0x7f95f810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:05.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f95f000de20 tx=0x7f95f0004ee0).stop 2021-01-27T09:26:05.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 shutdown_connections 2021-01-27T09:26:05.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> v2:172.21.15.103:6800/3303543367 conn(0x7f95d805bcb0 0x7f95d805e170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95f80f9290 0x7f95f810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f95f805f770 0x7f95f810bf20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 --2- 172.21.15.103:0/2232934242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95f80f67e0 0x7f95f810c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:05.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 >> 172.21.15.103:0/2232934242 conn(0x7f95f80eff70 msgr2=0x7f95f80f7420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:05.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 shutdown_connections 2021-01-27T09:26:05.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:05.855+0000 7f95f759e700 1 -- 172.21.15.103:0/2232934242 wait complete. 2021-01-27T09:26:06.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:06 smithi103 bash[9772]: cluster 2021-01-27T09:26:04.253622+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:06.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:06 smithi103 bash[9772]: audit 2021-01-27T09:26:05.854380+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.103:0/2232934242' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T09:26:06.035 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:06 smithi103 bash[13570]: cluster 2021-01-27T09:26:04.253622+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:06.227 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:05 smithi047 bash[24552]: t=2021-01-27T09:26:05+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-01-27T09:26:06.227 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[9721]: cluster 2021-01-27T09:26:04.253622+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:06.228 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[9721]: audit 2021-01-27T09:26:05.854380+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.103:0/2232934242' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T09:26:06.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:06 smithi103 bash[13570]: audit 2021-01-27T09:26:05.854380+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.103:0/2232934242' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T09:26:06.554 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[24552]: t=2021-01-27T09:26:06+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-01-27T09:26:06.572 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3303543367}]},"active_addr":"172.21.15.103:6800/3303543367","active_change":"2021-01-27T09:18:58.052608+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24115,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi103.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":91419536}]},{"addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":225841531}]},{"addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2022671170}]}]}} 2021-01-27T09:26:06.576 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-01-27T09:26:06.576 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-01-27T09:26:06.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T09:26:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:06.831 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[24552]: t=2021-01-27T09:26:06+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-01-27T09:26:06.831 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[24552]: t=2021-01-27T09:26:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-01-27T09:26:06.831 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:06 smithi047 docker[25166]: ceph-78337516-6080-11eb-8f9a-001a4aab830c-prometheus.a 2021-01-27T09:26:06.831 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:06 smithi047 systemd[1]: ceph-78337516-6080-11eb-8f9a-001a4aab830c@prometheus.a.service: Succeeded. 2021-01-27T09:26:06.832 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:06 smithi047 systemd[1]: Stopped Ceph prometheus.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:26:06.832 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:06 smithi047 systemd[1]: Started Ceph prometheus.a for 78337516-6080-11eb-8f9a-001a4aab830c. 2021-01-27T09:26:07.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[24552]: t=2021-01-27T09:26:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-01-27T09:26:07.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:06 smithi047 bash[24552]: t=2021-01-27T09:26:06+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-01-27T09:26:07.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[24552]: t=2021-01-27T09:26:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-01-27T09:26:07.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[24552]: t=2021-01-27T09:26:07+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-01-27T09:26:08.079 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: cluster 2021-01-27T09:26:06.254799+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:08.079 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.849968+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.080 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.856675+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.080 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.857490+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.081 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.859486+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.081 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.860032+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.081 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.866840+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.082 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.874413+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.082 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.874974+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.083 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.883399+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.083 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.884007+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.083 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.890747+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.084 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.898283+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.084 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.898906+0000 mgr.y (mgr.14138) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.085 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.910192+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.085 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.910741+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.086 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.918128+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.086 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.925729+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.087 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[13570]: audit 2021-01-27T09:26:06.926359+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: cluster 2021-01-27T09:26:06.254799+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:08.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.849968+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.856675+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.089 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.857490+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.089 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.859486+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.090 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.860032+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.090 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.866840+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.091 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.874413+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.091 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.874974+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.091 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.883399+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.092 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.884007+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.092 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.890747+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.898283+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.898906+0000 mgr.y (mgr.14138) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.910192+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.910741+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.918128+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.925729+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:07 smithi103 bash[9772]: audit 2021-01-27T09:26:06.926359+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:08 smithi047 bash[24552]: t=2021-01-27T09:26:08+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-01-27T09:26:08.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: cluster 2021-01-27T09:26:06.254799+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:08.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.849968+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.856675+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.857490+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T09:26:08.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.859486+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.860032+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi103:9093"}]: dispatch 2021-01-27T09:26:08.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.866840+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.874413+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.874974+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T09:26:08.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.883399+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.884007+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi047:9095"}]: dispatch 2021-01-27T09:26:08.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.890747+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.898283+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.898906+0000 mgr.y (mgr.14138) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T09:26:08.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.910192+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.910741+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi047:3000"}]: dispatch 2021-01-27T09:26:08.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.918128+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:08.309 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.925729+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.309 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:07 smithi047 bash[9721]: audit 2021-01-27T09:26:06.926359+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T09:26:08.797 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:08 smithi047 bash[24552]: t=2021-01-27T09:26:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-01-27T09:26:08.798 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:08 smithi047 bash[24552]: t=2021-01-27T09:26:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-01-27T09:26:09.054 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:08 smithi047 bash[24552]: t=2021-01-27T09:26:08+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-01-27T09:26:09.055 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:08 smithi047 bash[24552]: t=2021-01-27T09:26:08+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-01-27T09:26:09.310 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-01-27T09:26:09.311 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-01-27T09:26:09.311 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-01-27T09:26:09.521 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-01-27T09:26:09.521 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-01-27T09:26:09.521 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.307Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-27T09:26:09.522 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.307Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-27T09:26:09.522 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.307Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-27T09:26:09.522 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.307Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi047 (none))" 2021-01-27T09:26:09.522 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.308Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-27T09:26:09.523 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.308Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-27T09:26:09.523 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.309Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-27T09:26:09.523 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.309Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-27T09:26:09.523 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.312Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-27T09:26:09.523 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.313Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-01-27T09:26:09.524 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.313Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-01-27T09:26:09.524 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.313Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=501.238µs 2021-01-27T09:26:09.524 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.314Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-27T09:26:09.524 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.314Z caller=main.go:695 msg="TSDB started" 2021-01-27T09:26:09.524 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.314Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T09:26:09.525 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.316Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T09:26:09.525 INFO:journalctl@ceph.prometheus.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[25211]: level=info ts=2021-01-27T09:26:09.316Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T09:26:09.629 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-01-27T09:26:09.855 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 -- 172.21.15.103:0/54831326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f8d70 msgr2=0x7f48f00f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/54831326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f8d70 0x7f48f00f91d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f48e0004e30 tx=0x7f48e0009b30).stop 2021-01-27T09:26:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 -- 172.21.15.103:0/54831326 shutdown_connections 2021-01-27T09:26:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/54831326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f96c0 0x7f48f00fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/54831326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f7ad0 0x7f48f00f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/54831326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f8d70 0x7f48f00f91d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 -- 172.21.15.103:0/54831326 >> 172.21.15.103:0/54831326 conn(0x7f48f00f3550 msgr2=0x7f48f00f5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 -- 172.21.15.103:0/54831326 shutdown_connections 2021-01-27T09:26:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.847+0000 7f48f4fdb700 1 -- 172.21.15.103:0/54831326 wait complete. 2021-01-27T09:26:09.859 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 Processor -- start 2021-01-27T09:26:09.859 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- start start 2021-01-27T09:26:09.859 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f7ad0 0x7f48f0107d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f96c0 0x7f48f0108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0109580 con 0x7f48f00f7ad0 2021-01-27T09:26:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01096f0 con 0x7f48f00f8d70 2021-01-27T09:26:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01098b0 con 0x7f48f00f96c0 2021-01-27T09:26:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48effff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f96c0 0x7f48f0108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50152/0 (socket says 172.21.15.103:50152) 2021-01-27T09:26:09.861 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 -- 172.21.15.103:0/2657296826 learned_addr learned my addr 172.21.15.103:0/2657296826 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:09.862 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48ef7fe700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f7ad0 0x7f48f0107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:09.862 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 -- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f96c0 msgr2=0x7f48f0108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:09.862 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f96c0 0x7f48f0108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:09.862 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 -- 172.21.15.103:0/2657296826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f7ad0 msgr2=0x7f48f0107d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:09.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f7ad0 0x7f48f0107d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:09.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 -- 172.21.15.103:0/2657296826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0109a70 con 0x7f48f00f8d70 2021-01-27T09:26:09.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48eeffd700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f48e0004ca0 tx=0x7f48e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:09.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000e030 con 0x7f48f00f8d70 2021-01-27T09:26:09.863 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f0109cc0 con 0x7f48f00f8d70 2021-01-27T09:26:09.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f48e00093b0 con 0x7f48f00f8d70 2021-01-27T09:26:09.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0018070 con 0x7f48f00f8d70 2021-01-27T09:26:09.864 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.851+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f01103c0 con 0x7f48f00f8d70 2021-01-27T09:26:09.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f005d520 con 0x7f48f00f8d70 2021-01-27T09:26:09.865 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f48e001d420 con 0x7f48f00f8d70 2021-01-27T09:26:09.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48d7fff700 1 --2- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 0x7f48d805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:09.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f48e0077880 con 0x7f48f00f8d70 2021-01-27T09:26:09.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48ef7fe700 1 --2- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 0x7f48d805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:09.866 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.855+0000 7f48ef7fe700 1 --2- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 0x7f48d805e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f48e4009fd0 tx=0x7f48e400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:09.867 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:09.859+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f48f005d520 con 0x7f48f00f8d70 2021-01-27T09:26:09.897 INFO:journalctl@ceph.alertmanager.a.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[28456]: level=info ts=2021-01-27T09:26:09.619Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000995789s 2021-01-27T09:26:09.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[13570]: cluster 2021-01-27T09:26:08.255739+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:09.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[13570]: audit 2021-01-27T09:26:08.715652+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:09.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[13570]: cephadm 2021-01-27T09:26:08.716834+0000 mgr.y (mgr.14138) 373 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:26:09.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[9772]: cluster 2021-01-27T09:26:08.255739+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:09.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[9772]: audit 2021-01-27T09:26:08.715652+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:09.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:09 smithi103 bash[9772]: cephadm 2021-01-27T09:26:08.716834+0000 mgr.y (mgr.14138) 373 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:26:09.949 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[9721]: cluster 2021-01-27T09:26:08.255739+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:09.949 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[9721]: audit 2021-01-27T09:26:08.715652+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:09.949 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[9721]: cephadm 2021-01-27T09:26:08.716834+0000 mgr.y (mgr.14138) 373 : cephadm [INF] refreshing smithi103 facts 2021-01-27T09:26:09.950 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-01-27T09:26:09.950 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-01-27T09:26:09.950 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-01-27T09:26:09.950 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-01-27T09:26:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.023+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f005d520 con 0x7f48f00f8d70 2021-01-27T09:26:10.034 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.027+0000 7f48d7fff700 1 -- 172.21.15.103:0/2657296826 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18946 (secure 0 0 0) 0x7f48f005d520 con 0x7f48f00f8d70 2021-01-27T09:26:10.035 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:26:10.036 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":60,"fsid":"78337516-6080-11eb-8f9a-001a4aab830c","created":"2021-01-27T09:18:01.588153+0000","modified":"2021-01-27T09:24:59.213295+0000","last_up_change":"2021-01-27T09:24:21.305208+0000","last_in_change":"2021-01-27T09:24:21.305208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:19:50.945648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T09:24:16.794776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T09:24:36.207617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T09:24:36.720591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T09:24:38.736112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T09:24:41.735968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"1f24ac20-7f89-43af-a3a8-639f9c8f6050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2602844757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2602844757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2602844757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2602844757}]},"public_addr":"172.21.15.103:6801/2602844757","cluster_addr":"172.21.15.103:6802/2602844757","heartbeat_back_addr":"172.21.15.103:6804/2602844757","heartbeat_front_addr":"172.21.15.103:6803/2602844757","state":["exists","up"]},{"osd":1,"uuid":"9402fe53-72fb-42a6-abd3-eb3566983eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":2521419055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2521419055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2521419055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2521419055}]},"public_addr":"172.21.15.103:6805/2521419055","cluster_addr":"172.21.15.103:6806/2521419055","heartbeat_back_addr":"172.21.15.103:6808/2521419055","heartbeat_front_addr":"172.21.15.103:6807/2521419055","state":["exists","up"]},{"osd":2,"uuid":"ea23a69b-462d-45da-ba68-854ae5a3f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":3547869492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3547869492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3547869492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":3547869492}]},"public_addr":"172.21.15.103:6809/3547869492","cluster_addr":"172.21.15.103:6810/3547869492","heartbeat_back_addr":"172.21.15.103:6812/3547869492","heartbeat_front_addr":"172.21.15.103:6811/3547869492","state":["exists","up"]},{"osd":3,"uuid":"4cbd1716-a15a-4236-a1d4-690a914a5e55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6813","nonce":3546808739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3546808739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3546808739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6815","nonce":3546808739}]},"public_addr":"172.21.15.103:6813/3546808739","cluster_addr":"172.21.15.103:6814/3546808739","heartbeat_back_addr":"172.21.15.103:6816/3546808739","heartbeat_front_addr":"172.21.15.103:6815/3546808739","state":["exists","up"]},{"osd":4,"uuid":"236c2a5a-cd0f-4473-9374-76acb70278a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4117565580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":4117565580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":4117565580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4117565580}]},"public_addr":"172.21.15.47:6800/4117565580","cluster_addr":"172.21.15.47:6801/4117565580","heartbeat_back_addr":"172.21.15.47:6803/4117565580","heartbeat_front_addr":"172.21.15.47:6802/4117565580","state":["exists","up"]},{"osd":5,"uuid":"85931400-41a6-4838-aec6-8e7c174de20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2359739468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":2359739468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":2359739468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2359739468}]},"public_addr":"172.21.15.47:6804/2359739468","cluster_addr":"172.21.15.47:6805/2359739468","heartbeat_back_addr":"172.21.15.47:6807/2359739468","heartbeat_front_addr":"172.21.15.47:6806/2359739468","state":["exists","up"]},{"osd":6,"uuid":"8f56216b-b2c6-49af-83bd-371ed5651fb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":4157251446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":4157251446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":4157251446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":4157251446}]},"public_addr":"172.21.15.47:6808/4157251446","cluster_addr":"172.21.15.47:6809/4157251446","heartbeat_back_addr":"172.21.15.47:6811/4157251446","heartbeat_front_addr":"172.21.15.47:6810/4157251446","state":["exists","up"]},{"osd":7,"uuid":"c6c2ce68-a2c6-4b28-953c-4b1f08268400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1597879315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":1597879315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1597879315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1597879315}]},"public_addr":"172.21.15.47:6812/1597879315","cluster_addr":"172.21.15.47:6813/1597879315","heartbeat_back_addr":"172.21.15.47:6815/1597879315","heartbeat_front_addr":"172.21.15.47:6814/1597879315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:05.684210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:32.644783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:00.399048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:26.300080+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:53.132045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:21.575028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:50.871249+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:24:19.565757+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/3379424216":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/2682866920":"2021-01-28T09:18:58.052053+0000","172.21.15.103:0/164987907":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/662320151":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/9391381":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/1666229793":"2021-01-28T09:18:37.071944+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:26:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 msgr2=0x7f48d805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 0x7f48d805e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f48e4009fd0 tx=0x7f48e400b040).stop 2021-01-27T09:26:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 msgr2=0x7f48f0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:10.039 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f48e0004ca0 tx=0x7f48e0009b30).stop 2021-01-27T09:26:10.039 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 shutdown_connections 2021-01-27T09:26:10.039 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> v2:172.21.15.103:6800/3303543367 conn(0x7f48d805bc70 0x7f48d805e130 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48f00f96c0 0x7f48f0108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f00f7ad0 0x7f48f0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:10.041 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 --2- 172.21.15.103:0/2657296826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f00f8d70 0x7f48f0108200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:10.041 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 >> 172.21.15.103:0/2657296826 conn(0x7f48f00f3550 msgr2=0x7f48f00f68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:10.042 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 shutdown_connections 2021-01-27T09:26:10.042 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:10.031+0000 7f48f4fdb700 1 -- 172.21.15.103:0/2657296826 wait complete. 2021-01-27T09:26:10.225 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:09 smithi047 bash[24552]: t=2021-01-27T09:26:09+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-01-27T09:26:10.225 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-01-27T09:26:10.226 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-01-27T09:26:10.476 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-01-27T09:26:10.477 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-01-27T09:26:10.477 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-01-27T09:26:10.744 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-01-27T09:26:10.745 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-01-27T09:26:10.745 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-01-27T09:26:10.745 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-01-27T09:26:10.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: audit 2021-01-27T09:26:10.030284+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.103:0/2657296826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:10.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: audit 2021-01-27T09:26:10.069035+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:10.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: audit 2021-01-27T09:26:10.075600+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:10.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.077015+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:10.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.077768+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:10.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.078522+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:10.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.079234+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.079952+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:10.748 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.080659+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.748 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.081357+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.748 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: audit 2021-01-27T09:26:10.091461+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:10.748 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.092690+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:10.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.093168+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:10.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.093652+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:10.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.094086+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.094551+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:10.750 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.095011+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.750 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[9721]: cephadm 2021-01-27T09:26:10.095456+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:10.831 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-01-27T09:26:10.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T09:26:10.980 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:11.004 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-01-27T09:26:11.005 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-01-27T09:26:11.005 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:10 smithi047 bash[24552]: t=2021-01-27T09:26:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-01-27T09:26:11.005 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-01-27T09:26:11.031 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: audit 2021-01-27T09:26:10.030284+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.103:0/2657296826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:11.032 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: audit 2021-01-27T09:26:10.069035+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.032 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: audit 2021-01-27T09:26:10.075600+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.032 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.077015+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:11.032 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.077768+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:11.033 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.078522+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:11.033 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.079234+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.033 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.079952+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:11.033 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.080659+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.081357+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: audit 2021-01-27T09:26:10.091461+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.092690+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:11.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.093168+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:11.035 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.093652+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:11.035 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.094086+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.035 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.094551+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:11.035 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.095011+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.035 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[9772]: cephadm 2021-01-27T09:26:10.095456+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.036 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: audit 2021-01-27T09:26:10.030284+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.103:0/2657296826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:11.036 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: audit 2021-01-27T09:26:10.069035+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.036 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: audit 2021-01-27T09:26:10.075600+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.037 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.077015+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:11.037 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.077768+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:11.037 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.078522+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:11.037 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.079234+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.037 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.079952+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:11.038 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.080659+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.040 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.081357+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.040 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: audit 2021-01-27T09:26:10.091461+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' 2021-01-27T09:26:11.040 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.092690+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='y'), HostPlacementSpec(hostname='smithi047', network='', name='x')] + new hosts [] 2021-01-27T09:26:11.041 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.093168+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T09:26:11.041 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.093652+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='iscsi.a')] + new hosts [] 2021-01-27T09:26:11.041 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.094086+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.042 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.094551+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a'), HostPlacementSpec(hostname='smithi047', network='', name='b')] + new hosts [] 2021-01-27T09:26:11.042 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.095011+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi103', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.043 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:10 smithi103 bash[13570]: cephadm 2021-01-27T09:26:10.095456+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi047', network='', name='a')] + new hosts [] 2021-01-27T09:26:11.304 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-01-27T09:26:11.305 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-01-27T09:26:11.305 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-01-27T09:26:11.624 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-01-27T09:26:11.625 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-01-27T09:26:11.625 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-01-27T09:26:11.625 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-01-27T09:26:11.926 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-01-27T09:26:11.927 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-01-27T09:26:11.927 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-01-27T09:26:11.927 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-01-27T09:26:11.927 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-01-27T09:26:12.204 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[9721]: cluster 2021-01-27T09:26:10.257112+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:12.204 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:11 smithi047 bash[24552]: t=2021-01-27T09:26:11+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-01-27T09:26:12.204 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-01-27T09:26:12.205 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-01-27T09:26:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:12 smithi103 bash[9772]: cluster 2021-01-27T09:26:10.257112+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:12.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:12 smithi103 bash[13570]: cluster 2021-01-27T09:26:10.257112+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:12.489 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-01-27T09:26:12.585 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-01-27T09:26:12.585 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-01-27T09:26:12.585 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-01-27T09:26:12.586 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-01-27T09:26:12.586 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-01-27T09:26:12.586 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-01-27T09:26:12.586 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-01-27T09:26:12.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing HooksService" logger=server 2021-01-27T09:26:12.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-01-27T09:26:12.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-01-27T09:26:12.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-01-27T09:26:12.587 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-01-27T09:26:12.588 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-01-27T09:26:12.588 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-01-27T09:26:12.588 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-01-27T09:26:12.588 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-01-27T09:26:12.588 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-01-27T09:26:12.589 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing LoginService" logger=server 2021-01-27T09:26:12.589 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing SearchService" logger=server 2021-01-27T09:26:12.589 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing TracingService" logger=server 2021-01-27T09:26:12.589 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-01-27T09:26:12.589 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-01-27T09:26:12.590 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-01-27T09:26:12.590 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-01-27T09:26:12.590 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-01-27T09:26:12.590 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-01-27T09:26:12.591 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-01-27T09:26:12.591 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-01-27T09:26:12.804 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="Initializing Stream Manager" 2021-01-27T09:26:12.805 INFO:journalctl@ceph.grafana.a.smithi047.stdout:Jan 27 09:26:12 smithi047 bash[24552]: t=2021-01-27T09:26:12+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-01-27T09:26:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/1709112514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f5a40 msgr2=0x7fe9ac0f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/1709112514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f5ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe994004e30 tx=0x7fe994009b30).stop 2021-01-27T09:26:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/1709112514 shutdown_connections 2021-01-27T09:26:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/1709112514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/1709112514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/1709112514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f5ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.283 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/1709112514 >> 172.21.15.103:0/1709112514 conn(0x7fe9ac0effa0 msgr2=0x7fe9ac0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:14.283 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/1709112514 shutdown_connections 2021-01-27T09:26:14.283 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/1709112514 wait complete. 2021-01-27T09:26:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 Processor -- start 2021-01-27T09:26:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- start start 2021-01-27T09:26:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0f7ac0 con 0x7fe9ac0f6390 2021-01-27T09:26:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0f7c30 con 0x7fe9ac0f5a40 2021-01-27T09:26:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac10f900 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32922/0 (socket says 172.21.15.103:32922) 2021-01-27T09:26:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 -- 172.21.15.103:0/494047363 learned_addr learned my addr 172.21.15.103:0/494047363 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9a9d9b700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aad9d700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 -- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f5a40 msgr2=0x7fe9ac0f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 -- 172.21.15.103:0/494047363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 msgr2=0x7fe9ac0f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 -- 172.21.15.103:0/494047363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac10fac0 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aad9d700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9aa59c700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe99c00cc10 tx=0x7fe99c004d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00a860 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac10fd70 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.275+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac110270 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe99c00abd0 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c012ca0 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe990004da0 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fe99c019030 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a2ffd700 1 --2- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 0x7fe99805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fe99c075860 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a9d9b700 1 --2- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 0x7fe99805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.279+0000 7fe9a9d9b700 1 --2- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 0x7fe99805e130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe994009830 tx=0x7fe994009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.287+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe99c0458c0 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:14 smithi047 bash[9721]: cluster 2021-01-27T09:26:12.257883+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:14.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:13 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:14.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:14 smithi103 bash[9772]: cluster 2021-01-27T09:26:12.257883+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:14.397 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:13 smithi103 bash[10018]: debug 2021-01-27T09:26:13.955+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:14.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:14 smithi103 bash[13570]: cluster 2021-01-27T09:26:12.257883+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:14.464 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.459+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe990005470 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.467 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.459+0000 7fe9a2ffd700 1 -- 172.21.15.103:0/494047363 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18946 (secure 0 0 0) 0x7fe99c017090 con 0x7fe9ac0f47a0 2021-01-27T09:26:14.468 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:26:14.468 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":60,"fsid":"78337516-6080-11eb-8f9a-001a4aab830c","created":"2021-01-27T09:18:01.588153+0000","modified":"2021-01-27T09:24:59.213295+0000","last_up_change":"2021-01-27T09:24:21.305208+0000","last_in_change":"2021-01-27T09:24:21.305208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:19:50.945648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T09:24:16.794776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T09:24:36.207617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T09:24:36.720591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T09:24:38.736112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T09:24:41.735968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"1f24ac20-7f89-43af-a3a8-639f9c8f6050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":2602844757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2602844757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2602844757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":2602844757}]},"public_addr":"172.21.15.103:6801/2602844757","cluster_addr":"172.21.15.103:6802/2602844757","heartbeat_back_addr":"172.21.15.103:6804/2602844757","heartbeat_front_addr":"172.21.15.103:6803/2602844757","state":["exists","up"]},{"osd":1,"uuid":"9402fe53-72fb-42a6-abd3-eb3566983eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":2521419055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2521419055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2521419055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":2521419055}]},"public_addr":"172.21.15.103:6805/2521419055","cluster_addr":"172.21.15.103:6806/2521419055","heartbeat_back_addr":"172.21.15.103:6808/2521419055","heartbeat_front_addr":"172.21.15.103:6807/2521419055","state":["exists","up"]},{"osd":2,"uuid":"ea23a69b-462d-45da-ba68-854ae5a3f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6809","nonce":3547869492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3547869492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3547869492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":3547869492}]},"public_addr":"172.21.15.103:6809/3547869492","cluster_addr":"172.21.15.103:6810/3547869492","heartbeat_back_addr":"172.21.15.103:6812/3547869492","heartbeat_front_addr":"172.21.15.103:6811/3547869492","state":["exists","up"]},{"osd":3,"uuid":"4cbd1716-a15a-4236-a1d4-690a914a5e55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6813","nonce":3546808739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3546808739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3546808739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6815","nonce":3546808739}]},"public_addr":"172.21.15.103:6813/3546808739","cluster_addr":"172.21.15.103:6814/3546808739","heartbeat_back_addr":"172.21.15.103:6816/3546808739","heartbeat_front_addr":"172.21.15.103:6815/3546808739","state":["exists","up"]},{"osd":4,"uuid":"236c2a5a-cd0f-4473-9374-76acb70278a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4117565580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6801","nonce":4117565580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":4117565580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4117565580}]},"public_addr":"172.21.15.47:6800/4117565580","cluster_addr":"172.21.15.47:6801/4117565580","heartbeat_back_addr":"172.21.15.47:6803/4117565580","heartbeat_front_addr":"172.21.15.47:6802/4117565580","state":["exists","up"]},{"osd":5,"uuid":"85931400-41a6-4838-aec6-8e7c174de20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2359739468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":2359739468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":2359739468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2359739468}]},"public_addr":"172.21.15.47:6804/2359739468","cluster_addr":"172.21.15.47:6805/2359739468","heartbeat_back_addr":"172.21.15.47:6807/2359739468","heartbeat_front_addr":"172.21.15.47:6806/2359739468","state":["exists","up"]},{"osd":6,"uuid":"8f56216b-b2c6-49af-83bd-371ed5651fb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":4157251446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6809","nonce":4157251446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":4157251446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":4157251446}]},"public_addr":"172.21.15.47:6808/4157251446","cluster_addr":"172.21.15.47:6809/4157251446","heartbeat_back_addr":"172.21.15.47:6811/4157251446","heartbeat_front_addr":"172.21.15.47:6810/4157251446","state":["exists","up"]},{"osd":7,"uuid":"c6c2ce68-a2c6-4b28-953c-4b1f08268400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1597879315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6813","nonce":1597879315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1597879315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1597879315}]},"public_addr":"172.21.15.47:6812/1597879315","cluster_addr":"172.21.15.47:6813/1597879315","heartbeat_back_addr":"172.21.15.47:6815/1597879315","heartbeat_front_addr":"172.21.15.47:6814/1597879315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:05.684210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:21:32.644783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:00.399048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:26.300080+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:22:53.132045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:21.575028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:23:50.871249+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:24:19.565757+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/3379424216":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/2682866920":"2021-01-28T09:18:58.052053+0000","172.21.15.103:0/164987907":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/662320151":"2021-01-28T09:18:58.052053+0000","172.21.15.103:6800/9391381":"2021-01-28T09:18:37.071944+0000","172.21.15.103:0/1666229793":"2021-01-28T09:18:37.071944+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:26:14.469 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 msgr2=0x7fe99805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:14.469 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 0x7fe99805e130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe994009830 tx=0x7fe994009b30).stop 2021-01-27T09:26:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 msgr2=0x7fe9ac0f8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe99c00cc10 tx=0x7fe99c004d90).stop 2021-01-27T09:26:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 shutdown_connections 2021-01-27T09:26:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> v2:172.21.15.103:6800/3303543367 conn(0x7fe99805bc70 0x7fe99805e130 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.471 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac0f6390 0x7fe9ac0f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.471 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9ac0f47a0 0x7fe9ac0f8900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.471 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 --2- 172.21.15.103:0/494047363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9ac0f5a40 0x7fe9ac0f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:14.471 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 >> 172.21.15.103:0/494047363 conn(0x7fe9ac0effa0 msgr2=0x7fe9ac0f0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 shutdown_connections 2021-01-27T09:26:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:14.463+0000 7fe9ab59e700 1 -- 172.21.15.103:0/494047363 wait complete. 2021-01-27T09:26:15.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-01-27T09:26:15.381 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:15.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:15 smithi103 bash[13570]: audit 2021-01-27T09:26:13.960145+0000 mgr.y (mgr.14138) 390 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:15.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:15 smithi103 bash[13570]: audit 2021-01-27T09:26:14.463108+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.103:0/494047363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:15.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:15 smithi103 bash[9772]: audit 2021-01-27T09:26:13.960145+0000 mgr.y (mgr.14138) 390 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:15.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:15 smithi103 bash[9772]: audit 2021-01-27T09:26:14.463108+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.103:0/494047363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:15 smithi047 bash[9721]: audit 2021-01-27T09:26:13.960145+0000 mgr.y (mgr.14138) 390 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:15.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:15 smithi047 bash[9721]: audit 2021-01-27T09:26:14.463108+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.103:0/494047363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T09:26:16.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:16 smithi103 bash[9772]: cluster 2021-01-27T09:26:14.258962+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:16.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:16 smithi103 bash[13570]: cluster 2021-01-27T09:26:14.258962+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:16.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:16 smithi047 bash[9721]: cluster 2021-01-27T09:26:14.258962+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- 172.21.15.103:0/4222652024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55240fb4b0 msgr2=0x7f55240fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- 172.21.15.103:0/4222652024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55240fb4b0 0x7f55240fd940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5514004e00 tx=0x7f5514009b30).stop 2021-01-27T09:26:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- 172.21.15.103:0/4222652024 shutdown_connections 2021-01-27T09:26:18.396 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- 172.21.15.103:0/4222652024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55240fb4b0 0x7f55240fd940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.396 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- 172.21.15.103:0/4222652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552405f7d0 0x7f55240f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- 172.21.15.103:0/4222652024 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f55240f8a20 0x7f55240fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- 172.21.15.103:0/4222652024 >> 172.21.15.103:0/4222652024 conn(0x7f55240effe0 msgr2=0x7f55240f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- 172.21.15.103:0/4222652024 shutdown_connections 2021-01-27T09:26:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- 172.21.15.103:0/4222652024 wait complete. 2021-01-27T09:26:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 Processor -- start 2021-01-27T09:26:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- start start 2021-01-27T09:26:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 0x7f55240f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55240f8a20 0x7f55240f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f55240fb4b0 0x7f55240f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240f50e0 con 0x7f55240f8a20 2021-01-27T09:26:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240f5250 con 0x7f552405f7d0 2021-01-27T09:26:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552ab01700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552410f6d0 con 0x7f55240fb4b0 2021-01-27T09:26:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 0x7f55240f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 0x7f55240f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50178/0 (socket says 172.21.15.103:50178) 2021-01-27T09:26:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 -- 172.21.15.103:0/1815081555 learned_addr learned my addr 172.21.15.103:0/1815081555 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f552a300700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f55240fb4b0 0x7f55240f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f55292fe700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55240f8a20 0x7f55240f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 -- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f55240fb4b0 msgr2=0x7f55240f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f55240fb4b0 0x7f55240f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 -- 172.21.15.103:0/1815081555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55240f8a20 msgr2=0x7f55240f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55240f8a20 0x7f55240f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 -- 172.21.15.103:0/1815081555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552410f890 con 0x7f552405f7d0 2021-01-27T09:26:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f5529aff700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 0x7f55240f5f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f551c00eec0 tx=0x7f551c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.386+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0097b0 con 0x7f552405f7d0 2021-01-27T09:26:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f551c00f040 con 0x7f552405f7d0 2021-01-27T09:26:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552410fb40 con 0x7f552405f7d0 2021-01-27T09:26:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c007920 con 0x7f552405f7d0 2021-01-27T09:26:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5524110080 con 0x7f552405f7d0 2021-01-27T09:26:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f552405d580 con 0x7f552405f7d0 2021-01-27T09:26:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f551c01b030 con 0x7f552405f7d0 2021-01-27T09:26:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6800/3303543367 conn(0x7f550c05bc70 0x7f550c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f551c075950 con 0x7f552405f7d0 2021-01-27T09:26:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55292fe700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6800/3303543367 conn(0x7f550c05bc70 0x7f550c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6801/2602844757 conn(0x7f550c0655e0 0x7f550c067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 --> v2:172.21.15.103:6801/2602844757 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f550c0680c0 con 0x7f550c0655e0 2021-01-27T09:26:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.390+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551c07a220 con 0x7f552405f7d0 2021-01-27T09:26:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.394+0000 7f552a300700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6801/2602844757 conn(0x7f550c0655e0 0x7f550c067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.394+0000 7f55292fe700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6800/3303543367 conn(0x7f550c05bc70 0x7f550c05e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5518009fd0 tx=0x7f551800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.394+0000 7f552a300700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6801/2602844757 conn(0x7f550c0655e0 0x7f550c067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.394+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== osd.0 v2:172.21.15.103:6801/2602844757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f550c0680c0 con 0x7f550c0655e0 2021-01-27T09:26:18.413 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:18 smithi103 bash[13570]: cluster 2021-01-27T09:26:16.260081+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:18.414 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:18 smithi103 bash[9772]: cluster 2021-01-27T09:26:16.260081+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.410+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 --> v2:172.21.15.103:6801/2602844757 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5524057240 con 0x7f550c0655e0 2021-01-27T09:26:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.410+0000 7f55227fc700 1 -- 172.21.15.103:0/1815081555 <== osd.0 v2:172.21.15.103:6801/2602844757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5524057240 con 0x7f550c0655e0 2021-01-27T09:26:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6801/2602844757 conn(0x7f550c0655e0 msgr2=0x7f550c067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6801/2602844757 conn(0x7f550c0655e0 0x7f550c067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6800/3303543367 conn(0x7f550c05bc70 msgr2=0x7f550c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 --2- 172.21.15.103:0/1815081555 >> v2:172.21.15.103:6800/3303543367 conn(0x7f550c05bc70 0x7f550c05e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5518009fd0 tx=0x7f551800b040).stop 2021-01-27T09:26:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 msgr2=0x7f55240f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 --2- 172.21.15.103:0/1815081555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552405f7d0 0x7f55240f5f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f551c00eec0 tx=0x7f551c00b040).stop 2021-01-27T09:26:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552a300700 1 -- 172.21.15.103:0/1815081555 reap_dead start 2021-01-27T09:26:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 shutdown_connections 2021-01-27T09:26:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 >> 172.21.15.103:0/1815081555 conn(0x7f55240effe0 msgr2=0x7f55240fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 shutdown_connections 2021-01-27T09:26:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:18.414+0000 7f552ab01700 1 -- 172.21.15.103:0/1815081555 wait complete. 2021-01-27T09:26:18.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:18 smithi047 bash[9721]: cluster 2021-01-27T09:26:16.260081+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:42949673025 2021-01-27T09:26:19.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-01-27T09:26:19.296 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:20.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:20 smithi103 bash[9772]: cluster 2021-01-27T09:26:18.260804+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:20.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:20 smithi103 bash[13570]: cluster 2021-01-27T09:26:18.260804+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:20.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:20 smithi047 bash[9721]: cluster 2021-01-27T09:26:18.260804+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/787816240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 msgr2=0x7f9f0c0f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/787816240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c0f8480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9ef4009dc0 tx=0x7f9ef4004d10).stop 2021-01-27T09:26:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/787816240 shutdown_connections 2021-01-27T09:26:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/787816240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c0fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/787816240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c0f8480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/787816240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 0x7f9f0c0fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/787816240 >> 172.21.15.103:0/787816240 conn(0x7f9f0c0effa0 msgr2=0x7f9f0c0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/787816240 shutdown_connections 2021-01-27T09:26:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/787816240 wait complete. 2021-01-27T09:26:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 Processor -- start 2021-01-27T09:26:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- start start 2021-01-27T09:26:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c105860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 0x7f9f0c105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c106c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c107170 con 0x7f9f0c0f8a00 2021-01-27T09:26:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c1072e0 con 0x7f9f0c0fb490 2021-01-27T09:26:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c1074a0 con 0x7f9f0c05f7d0 2021-01-27T09:26:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c106c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0affd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c105860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c106c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50196/0 (socket says 172.21.15.103:50196) 2021-01-27T09:26:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 -- 172.21.15.103:0/595293453 learned_addr learned my addr 172.21.15.103:0/595293453 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0affd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c105860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32952/0 (socket says 172.21.15.103:32952) 2021-01-27T09:26:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0a7fc700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 0x7f9f0c105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 -- 172.21.15.103:0/595293453 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 msgr2=0x7f9f0c105860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f0c05f7d0 0x7f9f0c105860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 -- 172.21.15.103:0/595293453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 msgr2=0x7f9f0c105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 0x7f9f0c105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 -- 172.21.15.103:0/595293453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c107660 con 0x7f9f0c0fb490 2021-01-27T09:26:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0a7fc700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f0c0f8a00 0x7f9f0c105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0b7fe700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c106c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9f040029a0 tx=0x7f9f04009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04009320 con 0x7f9f0c0fb490 2021-01-27T09:26:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f9f0400f040 con 0x7f9f0c0fb490 2021-01-27T09:26:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c107910 con 0x7f9f0c0fb490 2021-01-27T09:26:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400d810 con 0x7f9f0c0fb490 2021-01-27T09:26:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.218+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c10e050 con 0x7f9f0c0fb490 2021-01-27T09:26:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f0c05e330 con 0x7f9f0c0fb490 2021-01-27T09:26:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f9f0401b060 con 0x7f9f0c0fb490 2021-01-27T09:26:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9ef805bc70 0x7f9ef805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f9f04075bf0 con 0x7f9f0c0fb490 2021-01-27T09:26:22.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f0affd700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9ef805bc70 0x7f9ef805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:22.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6805/2521419055 conn(0x7f9ef8065560 0x7f9ef8067a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:22.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 --> v2:172.21.15.103:6805/2521419055 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ef8068040 con 0x7f9ef8065560 2021-01-27T09:26:22.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f04075ff0 con 0x7f9f0c0fb490 2021-01-27T09:26:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f0a7fc700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6805/2521419055 conn(0x7f9ef8065560 0x7f9ef8067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f0affd700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9ef805bc70 0x7f9ef805e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9ef4007680 tx=0x7f9ef4004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f0a7fc700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6805/2521419055 conn(0x7f9ef8065560 0x7f9ef8067a00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.222+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== osd.1 v2:172.21.15.103:6805/2521419055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f9ef8068040 con 0x7f9ef8065560 2021-01-27T09:26:22.248 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.238+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 --> v2:172.21.15.103:6805/2521419055 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f0c057240 con 0x7f9ef8065560 2021-01-27T09:26:22.249 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f037fe700 1 -- 172.21.15.103:0/595293453 <== osd.1 v2:172.21.15.103:6805/2521419055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f0c057240 con 0x7f9ef8065560 2021-01-27T09:26:22.249 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6805/2521419055 conn(0x7f9ef8065560 msgr2=0x7f9ef8067a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6805/2521419055 conn(0x7f9ef8065560 0x7f9ef8067a00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:22.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9ef805bc70 msgr2=0x7f9ef805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/595293453 >> v2:172.21.15.103:6800/3303543367 conn(0x7f9ef805bc70 0x7f9ef805e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9ef4007680 tx=0x7f9ef4004d10).stop 2021-01-27T09:26:22.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 msgr2=0x7f9f0c106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:22.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 --2- 172.21.15.103:0/595293453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f0c0fb490 0x7f9f0c106c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9f040029a0 tx=0x7f9f04009de0).stop 2021-01-27T09:26:22.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0b7fe700 1 -- 172.21.15.103:0/595293453 reap_dead start 2021-01-27T09:26:22.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 shutdown_connections 2021-01-27T09:26:22.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 >> 172.21.15.103:0/595293453 conn(0x7f9f0c0effa0 msgr2=0x7f9f0c0fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:22.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 shutdown_connections 2021-01-27T09:26:22.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:22.242+0000 7f9f0bfff700 1 -- 172.21.15.103:0/595293453 wait complete. 2021-01-27T09:26:22.307 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:22 smithi103 bash[9772]: cluster 2021-01-27T09:26:20.262155+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:22.307 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:22 smithi103 bash[13570]: cluster 2021-01-27T09:26:20.262155+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:22.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:22 smithi047 bash[9721]: cluster 2021-01-27T09:26:20.262155+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:68719476797 2021-01-27T09:26:22.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-01-27T09:26:23.149 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:24.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:24 smithi047 bash[9721]: cluster 2021-01-27T09:26:22.263114+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:24.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:23 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:24.307 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:24 smithi103 bash[9772]: cluster 2021-01-27T09:26:22.263114+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:24.307 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:23 smithi103 bash[10018]: debug 2021-01-27T09:26:23.958+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:24.307 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:24 smithi103 bash[13570]: cluster 2021-01-27T09:26:22.263114+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:25.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:25 smithi103 bash[13570]: audit 2021-01-27T09:26:23.962096+0000 mgr.y (mgr.14138) 396 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:25.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:25 smithi103 bash[9772]: audit 2021-01-27T09:26:23.962096+0000 mgr.y (mgr.14138) 396 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:25.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:25 smithi047 bash[9721]: audit 2021-01-27T09:26:23.962096+0000 mgr.y (mgr.14138) 396 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:26.141 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 -- 172.21.15.103:0/1520690169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29080fb640 msgr2=0x7f29080fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.142 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 --2- 172.21.15.103:0/1520690169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29080fb640 0x7f29080fdad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f28f0004e00 tx=0x7f28f0009b30).stop 2021-01-27T09:26:26.142 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 -- 172.21.15.103:0/1520690169 shutdown_connections 2021-01-27T09:26:26.142 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 --2- 172.21.15.103:0/1520690169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29080fb640 0x7f29080fdad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.143 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 --2- 172.21.15.103:0/1520690169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f290805fbc0 0x7f29080f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.143 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 --2- 172.21.15.103:0/1520690169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 0x7f29080fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.144 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.130+0000 7f290d398700 1 -- 172.21.15.103:0/1520690169 >> 172.21.15.103:0/1520690169 conn(0x7f29080f0170 msgr2=0x7f29080f2590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:26.144 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- 172.21.15.103:0/1520690169 shutdown_connections 2021-01-27T09:26:26.144 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- 172.21.15.103:0/1520690169 wait complete. 2021-01-27T09:26:26.145 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 Processor -- start 2021-01-27T09:26:26.145 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- start start 2021-01-27T09:26:26.150 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290805fbc0 0x7f2908105670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:26.150 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 0x7f2908105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:26.151 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29080fb640 0x7f290810cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:26.151 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290810d130 con 0x7f29080fb640 2021-01-27T09:26:26.151 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290810d270 con 0x7f29080f8bb0 2021-01-27T09:26:26.152 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290810d3b0 con 0x7f290805fbc0 2021-01-27T09:26:26.152 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f29067fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 0x7f2908105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:26.153 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290805fbc0 0x7f2908105670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:26.153 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f29067fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 0x7f2908105b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50212/0 (socket says 172.21.15.103:50212) 2021-01-27T09:26:26.153 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f29067fc700 1 -- 172.21.15.103:0/1181140289 learned_addr learned my addr 172.21.15.103:0/1181140289 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:26.154 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f29077fe700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29080fb640 0x7f290810cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:26.154 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 -- 172.21.15.103:0/1181140289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 msgr2=0x7f2908105b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.155 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29080f8bb0 0x7f2908105b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.155 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 -- 172.21.15.103:0/1181140289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29080fb640 msgr2=0x7f290810cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.155 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29080fb640 0x7f290810cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.156 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 -- 172.21.15.103:0/1181140289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290810d570 con 0x7f290805fbc0 2021-01-27T09:26:26.156 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f29077fe700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29080fb640 0x7f290810cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:26:26.157 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f2906ffd700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290805fbc0 0x7f2908105670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f290000fed0 tx=0x7f2900004de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:26.157 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900014070 con 0x7f290805fbc0 2021-01-27T09:26:26.157 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2900011bb0 con 0x7f290805fbc0 2021-01-27T09:26:26.158 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900019e90 con 0x7f290805fbc0 2021-01-27T09:26:26.158 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29080f4470 con 0x7f290805fbc0 2021-01-27T09:26:26.158 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080f49e0 con 0x7f290805fbc0 2021-01-27T09:26:26.159 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.134+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2908045420 con 0x7f290805fbc0 2021-01-27T09:26:26.159 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f2900019420 con 0x7f290805fbc0 2021-01-27T09:26:26.159 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f28e805bd20 0x7f28e805e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:26.159 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f290007b1f0 con 0x7f290805fbc0 2021-01-27T09:26:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f29067fc700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f28e805bd20 0x7f28e805e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6809/3547869492 conn(0x7f28e8065510 0x7f28e80679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 --> v2:172.21.15.103:6809/3547869492 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28e8067ff0 con 0x7f28e8065510 2021-01-27T09:26:26.160 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f290007b5f0 con 0x7f290805fbc0 2021-01-27T09:26:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f29077fe700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6809/3547869492 conn(0x7f28e8065510 0x7f28e80679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f29067fc700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f28e805bd20 0x7f28e805e1e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f28f80041d0 tx=0x7f28f800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.138+0000 7f29077fe700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6809/3547869492 conn(0x7f28e8065510 0x7f28e80679b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.142+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== osd.2 v2:172.21.15.103:6809/3547869492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f28e8067ff0 con 0x7f28e8065510 2021-01-27T09:26:26.169 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 --> v2:172.21.15.103:6809/3547869492 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2908057280 con 0x7f28e8065510 2021-01-27T09:26:26.170 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f28ff7fe700 1 -- 172.21.15.103:0/1181140289 <== osd.2 v2:172.21.15.103:6809/3547869492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2908057280 con 0x7f28e8065510 2021-01-27T09:26:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6809/3547869492 conn(0x7f28e8065510 msgr2=0x7f28e80679b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6809/3547869492 conn(0x7f28e8065510 0x7f28e80679b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f28e805bd20 msgr2=0x7f28e805e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 --2- 172.21.15.103:0/1181140289 >> v2:172.21.15.103:6800/3303543367 conn(0x7f28e805bd20 0x7f28e805e1e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f28f80041d0 tx=0x7f28f800b040).stop 2021-01-27T09:26:26.171 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290805fbc0 msgr2=0x7f2908105670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 --2- 172.21.15.103:0/1181140289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290805fbc0 0x7f2908105670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f290000fed0 tx=0x7f2900004de0).stop 2021-01-27T09:26:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f29077fe700 1 -- 172.21.15.103:0/1181140289 reap_dead start 2021-01-27T09:26:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 shutdown_connections 2021-01-27T09:26:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 >> 172.21.15.103:0/1181140289 conn(0x7f29080f0170 msgr2=0x7f29080fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 shutdown_connections 2021-01-27T09:26:26.173 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:26.162+0000 7f290d398700 1 -- 172.21.15.103:0/1181140289 wait complete. 2021-01-27T09:26:26.225 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:26 smithi103 bash[13570]: cluster 2021-01-27T09:26:24.264227+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:26.226 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:26 smithi103 bash[9772]: cluster 2021-01-27T09:26:24.264227+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:26.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:26 smithi047 bash[9721]: cluster 2021-01-27T09:26:24.264227+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T09:26:26.877 INFO:teuthology.orchestra.run.smithi103.stdout:90194313272 2021-01-27T09:26:26.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-01-27T09:26:27.033 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:28.377 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:28 smithi103 bash[13570]: cluster 2021-01-27T09:26:26.265430+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:28.377 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:28 smithi103 bash[9772]: cluster 2021-01-27T09:26:26.265430+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:28.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:28 smithi047 bash[9721]: cluster 2021-01-27T09:26:26.265430+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:30.104 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 -- 172.21.15.103:0/1685590130 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac06aa30 msgr2=0x7f76ac068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.104 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1685590130 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac06aa30 0x7f76ac068f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f769c004d40 tx=0x7f769c009b30).stop 2021-01-27T09:26:30.104 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 -- 172.21.15.103:0/1685590130 shutdown_connections 2021-01-27T09:26:30.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1685590130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76ac0fd850 0x7f76ac0ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1685590130 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac06aa30 0x7f76ac068f30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1685590130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76ac069420 0x7f76ac0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 -- 172.21.15.103:0/1685590130 >> 172.21.15.103:0/1685590130 conn(0x7f76ac0f10a0 msgr2=0x7f76ac0f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:30.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 -- 172.21.15.103:0/1685590130 shutdown_connections 2021-01-27T09:26:30.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.094+0000 7f76b10e2700 1 -- 172.21.15.103:0/1685590130 wait complete. 2021-01-27T09:26:30.107 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 Processor -- start 2021-01-27T09:26:30.107 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- start start 2021-01-27T09:26:30.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76ac069420 0x7f76ac107c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:30.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 0x7f76ac108100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:30.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76ac108ff0 0x7f76ac109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:30.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac109960 con 0x7f76ac069420 2021-01-27T09:26:30.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac109ad0 con 0x7f76ac108ff0 2021-01-27T09:26:30.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac109c90 con 0x7f76ac0fd850 2021-01-27T09:26:30.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 0x7f76ac108100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:30.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 0x7f76ac108100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:32986/0 (socket says 172.21.15.103:32986) 2021-01-27T09:26:30.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 -- 172.21.15.103:0/1659394460 learned_addr learned my addr 172.21.15.103:0/1659394460 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:30.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b08e1700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76ac108ff0 0x7f76ac109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:30.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76abfff700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76ac069420 0x7f76ac107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:30.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 -- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76ac108ff0 msgr2=0x7f76ac109470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76ac108ff0 0x7f76ac109470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 -- 172.21.15.103:0/1659394460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76ac069420 msgr2=0x7f76ac107c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76ac069420 0x7f76ac107c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 -- 172.21.15.103:0/1659394460 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac109e50 con 0x7f76ac0fd850 2021-01-27T09:26:30.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76ab7fe700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 0x7f76ac108100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f769800ebc0 tx=0x7f769800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:30.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980092e0 con 0x7f76ac0fd850 2021-01-27T09:26:30.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f769800f040 con 0x7f76ac0fd850 2021-01-27T09:26:30.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac110300 con 0x7f76ac0fd850 2021-01-27T09:26:30.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698007ea0 con 0x7f76ac0fd850 2021-01-27T09:26:30.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.098+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac110840 con 0x7f76ac0fd850 2021-01-27T09:26:30.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76ac05e330 con 0x7f76ac0fd850 2021-01-27T09:26:30.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f76980077b0 con 0x7f76ac0fd850 2021-01-27T09:26:30.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6800/3303543367 conn(0x7f769005bc70 0x7f769005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:30.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f76980761c0 con 0x7f76ac0fd850 2021-01-27T09:26:30.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76abfff700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6800/3303543367 conn(0x7f769005bc70 0x7f769005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:30.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6813/3546808739 conn(0x7f76900655e0 0x7f7690067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:30.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 --> v2:172.21.15.103:6813/3546808739 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76900680c0 con 0x7f76900655e0 2021-01-27T09:26:30.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76980765c0 con 0x7f76ac0fd850 2021-01-27T09:26:30.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76b08e1700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6813/3546808739 conn(0x7f76900655e0 0x7f7690067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:30.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.102+0000 7f76abfff700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6800/3303543367 conn(0x7f769005bc70 0x7f769005e130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f769c004d10 tx=0x7f769c009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:30.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.106+0000 7f76b08e1700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6813/3546808739 conn(0x7f76900655e0 0x7f7690067a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:30.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.106+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== osd.3 v2:172.21.15.103:6813/3546808739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f76900680c0 con 0x7f76900655e0 2021-01-27T09:26:30.133 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 --> v2:172.21.15.103:6813/3546808739 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76ac0f3600 con 0x7f76900655e0 2021-01-27T09:26:30.134 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76a8ff9700 1 -- 172.21.15.103:0/1659394460 <== osd.3 v2:172.21.15.103:6813/3546808739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f76ac0f3600 con 0x7f76900655e0 2021-01-27T09:26:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6813/3546808739 conn(0x7f76900655e0 msgr2=0x7f7690067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6813/3546808739 conn(0x7f76900655e0 0x7f7690067a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6800/3303543367 conn(0x7f769005bc70 msgr2=0x7f769005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1659394460 >> v2:172.21.15.103:6800/3303543367 conn(0x7f769005bc70 0x7f769005e130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f769c004d10 tx=0x7f769c009b30).stop 2021-01-27T09:26:30.136 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 msgr2=0x7f76ac108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 --2- 172.21.15.103:0/1659394460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f76ac0fd850 0x7f76ac108100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f769800ebc0 tx=0x7f769800b040).stop 2021-01-27T09:26:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b08e1700 1 -- 172.21.15.103:0/1659394460 reap_dead start 2021-01-27T09:26:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 shutdown_connections 2021-01-27T09:26:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 >> 172.21.15.103:0/1659394460 conn(0x7f76ac0f10a0 msgr2=0x7f76ac0f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:30.138 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 shutdown_connections 2021-01-27T09:26:30.139 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:30.126+0000 7f76b10e2700 1 -- 172.21.15.103:0/1659394460 wait complete. 2021-01-27T09:26:30.192 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:30 smithi103 bash[13570]: cluster 2021-01-27T09:26:28.266384+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:30.192 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:30 smithi103 bash[9772]: cluster 2021-01-27T09:26:28.266384+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:30.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:30 smithi047 bash[9721]: cluster 2021-01-27T09:26:28.266384+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:30.902 INFO:teuthology.orchestra.run.smithi103.stdout:111669149747 2021-01-27T09:26:30.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-01-27T09:26:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:32.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:32 smithi103 bash[13570]: cluster 2021-01-27T09:26:30.267536+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:32.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:32 smithi103 bash[9772]: cluster 2021-01-27T09:26:30.267536+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:32.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:32 smithi047 bash[9721]: cluster 2021-01-27T09:26:30.267536+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- 172.21.15.103:0/1833338151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e9006aa30 msgr2=0x7f1e90068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/1833338151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e9006aa30 0x7f1e90068f30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1e80009dc0 tx=0x7f1e80004d10).stop 2021-01-27T09:26:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- 172.21.15.103:0/1833338151 shutdown_connections 2021-01-27T09:26:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/1833338151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e900fd850 0x7f1e900ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/1833338151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e9006aa30 0x7f1e90068f30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/1833338151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90069420 0x7f1e900698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- 172.21.15.103:0/1833338151 >> 172.21.15.103:0/1833338151 conn(0x7f1e900f10a0 msgr2=0x7f1e900f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:33.964 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- 172.21.15.103:0/1833338151 shutdown_connections 2021-01-27T09:26:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- 172.21.15.103:0/1833338151 wait complete. 2021-01-27T09:26:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 Processor -- start 2021-01-27T09:26:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- start start 2021-01-27T09:26:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 0x7f1e90107d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e900fd850 0x7f1e90108220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90108fd0 0x7f1e90109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90109980 con 0x7f1e900fd850 2021-01-27T09:26:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90109af0 con 0x7f1e90108fd0 2021-01-27T09:26:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8f59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90109cb0 con 0x7f1e90069420 2021-01-27T09:26:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8e59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 0x7f1e90107d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:33.969 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8e59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 0x7f1e90107d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33000/0 (socket says 172.21.15.103:33000) 2021-01-27T09:26:33.969 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8e59c700 1 -- 172.21.15.103:0/3651424361 learned_addr learned my addr 172.21.15.103:0/3651424361 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:33.969 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8ed9d700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90108fd0 0x7f1e90109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:33.969 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.954+0000 7f1e8dd9b700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e900fd850 0x7f1e90108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 -- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90108fd0 msgr2=0x7f1e90109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90108fd0 0x7f1e90109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 -- 172.21.15.103:0/3651424361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e900fd850 msgr2=0x7f1e90108220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e900fd850 0x7f1e90108220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 -- 172.21.15.103:0/3651424361 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90110220 con 0x7f1e90069420 2021-01-27T09:26:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8ed9d700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e90108fd0 0x7f1e90109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:26:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8e59c700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 0x7f1e90107d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1e80003380 tx=0x7f1e80004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e90069420 2021-01-27T09:26:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1e80007e10 con 0x7f1e90069420 2021-01-27T09:26:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e901103b0 con 0x7f1e90069420 2021-01-27T09:26:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80019070 con 0x7f1e90069420 2021-01-27T09:26:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e90110700 con 0x7f1e90069420 2021-01-27T09:26:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e9005e330 con 0x7f1e90069420 2021-01-27T09:26:33.973 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f1e80025060 con 0x7f1e90069420 2021-01-27T09:26:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.103:6800/3303543367 conn(0x7f1e7c05bc70 0x7f1e7c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f1e80077ba0 con 0x7f1e90069420 2021-01-27T09:26:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e8dd9b700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.103:6800/3303543367 conn(0x7f1e7c05bc70 0x7f1e7c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.47:6800/4117565580 conn(0x7f1e7c065560 0x7f1e7c067a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 --> v2:172.21.15.47:6800/4117565580 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e7c068040 con 0x7f1e7c065560 2021-01-27T09:26:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.958+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e80077fa0 con 0x7f1e90069420 2021-01-27T09:26:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.962+0000 7f1e8dd9b700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.103:6800/3303543367 conn(0x7f1e7c05bc70 0x7f1e7c05e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1e78007f60 tx=0x7f1e7800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.962+0000 7f1e8ed9d700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.47:6800/4117565580 conn(0x7f1e7c065560 0x7f1e7c067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.962+0000 7f1e8ed9d700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.47:6800/4117565580 conn(0x7f1e7c065560 0x7f1e7c067a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:33.976 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.962+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== osd.4 v2:172.21.15.47:6800/4117565580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f1e7c068040 con 0x7f1e7c065560 2021-01-27T09:26:33.992 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 --> v2:172.21.15.47:6800/4117565580 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e900f3640 con 0x7f1e7c065560 2021-01-27T09:26:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e86ffd700 1 -- 172.21.15.103:0/3651424361 <== osd.4 v2:172.21.15.47:6800/4117565580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1e900f3640 con 0x7f1e7c065560 2021-01-27T09:26:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 >> v2:172.21.15.47:6800/4117565580 conn(0x7f1e7c065560 msgr2=0x7f1e7c067a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.47:6800/4117565580 conn(0x7f1e7c065560 0x7f1e7c067a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 >> v2:172.21.15.103:6800/3303543367 conn(0x7f1e7c05bc70 msgr2=0x7f1e7c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/3651424361 >> v2:172.21.15.103:6800/3303543367 conn(0x7f1e7c05bc70 0x7f1e7c05e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1e78007f60 tx=0x7f1e7800b040).stop 2021-01-27T09:26:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 msgr2=0x7f1e90107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 --2- 172.21.15.103:0/3651424361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e90069420 0x7f1e90107d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1e80003380 tx=0x7f1e80004d10).stop 2021-01-27T09:26:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8ed9d700 1 -- 172.21.15.103:0/3651424361 reap_dead start 2021-01-27T09:26:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 shutdown_connections 2021-01-27T09:26:33.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 >> 172.21.15.103:0/3651424361 conn(0x7f1e900f10a0 msgr2=0x7f1e900f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:33.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 shutdown_connections 2021-01-27T09:26:33.997 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:33.986+0000 7f1e8f59e700 1 -- 172.21.15.103:0/3651424361 wait complete. 2021-01-27T09:26:34.054 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:33 smithi103 bash[10018]: debug 2021-01-27T09:26:33.966+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:34.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:33 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:34.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:34 smithi047 bash[9721]: cluster 2021-01-27T09:26:32.268393+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:34 smithi103 bash[9772]: cluster 2021-01-27T09:26:32.268393+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:34.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:34 smithi103 bash[13570]: cluster 2021-01-27T09:26:32.268393+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:34.759 INFO:teuthology.orchestra.run.smithi103.stdout:133143986221 2021-01-27T09:26:34.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-01-27T09:26:34.916 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:35.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:35 smithi103 bash[13570]: audit 2021-01-27T09:26:33.972322+0000 mgr.y (mgr.14138) 402 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:35 smithi103 bash[9772]: audit 2021-01-27T09:26:33.972322+0000 mgr.y (mgr.14138) 402 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:35.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:35 smithi047 bash[9721]: audit 2021-01-27T09:26:33.972322+0000 mgr.y (mgr.14138) 402 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:36.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:36 smithi047 bash[9721]: cluster 2021-01-27T09:26:34.269644+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2021-01-27T09:26:36.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:36 smithi103 bash[9772]: cluster 2021-01-27T09:26:34.269644+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2021-01-27T09:26:36.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:36 smithi103 bash[13570]: cluster 2021-01-27T09:26:34.269644+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2021-01-27T09:26:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 -- 172.21.15.103:0/227878520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40fd810 msgr2=0x7feee41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 --2- 172.21.15.103:0/227878520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40fd810 0x7feee41043d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7feed4009dc0 tx=0x7feed4004d10).stop 2021-01-27T09:26:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 -- 172.21.15.103:0/227878520 shutdown_connections 2021-01-27T09:26:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 --2- 172.21.15.103:0/227878520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee40fd810 0x7feee41043d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 --2- 172.21.15.103:0/227878520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee40fbe70 0x7feee40fc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 --2- 172.21.15.103:0/227878520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fc7a0 0x7feee40fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 -- 172.21.15.103:0/227878520 >> 172.21.15.103:0/227878520 conn(0x7feee406b0e0 msgr2=0x7feee406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 -- 172.21.15.103:0/227878520 shutdown_connections 2021-01-27T09:26:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.742+0000 7feee359e700 1 -- 172.21.15.103:0/227878520 wait complete. 2021-01-27T09:26:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 Processor -- start 2021-01-27T09:26:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- start start 2021-01-27T09:26:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 0x7feee410bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee40fd810 0x7feee410c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee410cfd0 0x7feee410d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee410d980 con 0x7feee40fd810 2021-01-27T09:26:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee410daf0 con 0x7feee410cfd0 2021-01-27T09:26:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee410dcb0 con 0x7feee40fbe70 2021-01-27T09:26:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 0x7feee410bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee2d9d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee410cfd0 0x7feee410d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:37.757 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 0x7feee410bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33016/0 (socket says 172.21.15.103:33016) 2021-01-27T09:26:37.757 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 -- 172.21.15.103:0/3801737563 learned_addr learned my addr 172.21.15.103:0/3801737563 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:37.757 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee1d9b700 1 --2- 172.21.15.103:0/3801737563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee40fd810 0x7feee410c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:37.759 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 -- 172.21.15.103:0/3801737563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee410cfd0 msgr2=0x7feee410d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.760 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 --2- 172.21.15.103:0/3801737563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee410cfd0 0x7feee410d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.760 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 -- 172.21.15.103:0/3801737563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee40fd810 msgr2=0x7feee410c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.760 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 --2- 172.21.15.103:0/3801737563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee40fd810 0x7feee410c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.760 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 -- 172.21.15.103:0/3801737563 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4114220 con 0x7feee40fbe70 2021-01-27T09:26:37.761 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee259c700 1 --2- 172.21.15.103:0/3801737563 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 0x7feee410bd30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7feecc002a50 tx=0x7feecc009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:37.761 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc009320 con 0x7feee40fbe70 2021-01-27T09:26:37.761 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7feecc00f040 con 0x7feee40fbe70 2021-01-27T09:26:37.761 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00d810 con 0x7feee40fbe70 2021-01-27T09:26:37.762 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee41143b0 con 0x7feee40fbe70 2021-01-27T09:26:37.762 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.746+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee41148a0 con 0x7feee40fbe70 2021-01-27T09:26:37.762 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feee405d580 con 0x7feee40fbe70 2021-01-27T09:26:37.762 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7feecc00dc40 con 0x7feee40fbe70 2021-01-27T09:26:37.762 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.103:6800/3303543367 conn(0x7feed005bc70 0x7feed005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:37.763 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feee1d9b700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.103:6800/3303543367 conn(0x7feed005bc70 0x7feed005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:37.763 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7feecc075b70 con 0x7feee40fbe70 2021-01-27T09:26:37.763 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.47:6804/2359739468 conn(0x7feed00655e0 0x7feed0067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:37.763 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 --> v2:172.21.15.47:6804/2359739468 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feed00680c0 con 0x7feed00655e0 2021-01-27T09:26:37.763 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7feecc07a220 con 0x7feee40fbe70 2021-01-27T09:26:37.764 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feee1d9b700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.103:6800/3303543367 conn(0x7feed005bc70 0x7feed005e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7feedc009fd0 tx=0x7feedc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:37.764 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.750+0000 7feee2d9d700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.47:6804/2359739468 conn(0x7feed00655e0 0x7feed0067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:37.765 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.754+0000 7feee2d9d700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.47:6804/2359739468 conn(0x7feed00655e0 0x7feed0067a80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:37.765 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.754+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== osd.5 v2:172.21.15.47:6804/2359739468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7feed00680c0 con 0x7feed00655e0 2021-01-27T09:26:37.782 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 --> v2:172.21.15.47:6804/2359739468 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feee40fca20 con 0x7feed00655e0 2021-01-27T09:26:37.783 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feedaffd700 1 -- 172.21.15.103:0/3801737563 <== osd.5 v2:172.21.15.47:6804/2359739468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feee40fca20 con 0x7feed00655e0 2021-01-27T09:26:37.784 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 >> v2:172.21.15.47:6804/2359739468 conn(0x7feed00655e0 msgr2=0x7feed0067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.784 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.47:6804/2359739468 conn(0x7feed00655e0 0x7feed0067a80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:37.785 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 >> v2:172.21.15.103:6800/3303543367 conn(0x7feed005bc70 msgr2=0x7feed005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.785 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 --2- 172.21.15.103:0/3801737563 >> v2:172.21.15.103:6800/3303543367 conn(0x7feed005bc70 0x7feed005e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7feedc009fd0 tx=0x7feedc00b040).stop 2021-01-27T09:26:37.785 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 msgr2=0x7feee410bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:37.786 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee359e700 1 --2- 172.21.15.103:0/3801737563 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feee40fbe70 0x7feee410bd30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7feecc002a50 tx=0x7feecc009d80).stop 2021-01-27T09:26:37.786 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.774+0000 7feee2d9d700 1 -- 172.21.15.103:0/3801737563 reap_dead start 2021-01-27T09:26:37.786 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.778+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 shutdown_connections 2021-01-27T09:26:37.786 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.778+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 >> 172.21.15.103:0/3801737563 conn(0x7feee406b0e0 msgr2=0x7feee406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:37.786 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.778+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 shutdown_connections 2021-01-27T09:26:37.787 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:37.778+0000 7feee359e700 1 -- 172.21.15.103:0/3801737563 wait complete. 2021-01-27T09:26:38.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:38 smithi103 bash[13570]: cluster 2021-01-27T09:26:36.270811+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:26:38.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:38 smithi103 bash[9772]: cluster 2021-01-27T09:26:36.270811+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:26:38.466 INFO:teuthology.orchestra.run.smithi103.stdout:154618822697 2021-01-27T09:26:38.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-01-27T09:26:38.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:38 smithi047 bash[9721]: cluster 2021-01-27T09:26:36.270811+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:26:38.613 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:40.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:40 smithi047 bash[9721]: cluster 2021-01-27T09:26:38.271876+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:40.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:40 smithi103 bash[9772]: cluster 2021-01-27T09:26:38.271876+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:40.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:40 smithi103 bash[13570]: cluster 2021-01-27T09:26:38.271876+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 -- 172.21.15.103:0/562737689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0f8a00 msgr2=0x7f0a4c0fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 --2- 172.21.15.103:0/562737689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0f8a00 0x7f0a4c0fae50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0a3c004e00 tx=0x7f0a3c009b30).stop 2021-01-27T09:26:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 -- 172.21.15.103:0/562737689 shutdown_connections 2021-01-27T09:26:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 --2- 172.21.15.103:0/562737689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c0fb490 0x7f0a4c0fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 --2- 172.21.15.103:0/562737689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c05f7d0 0x7f0a4c0f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 --2- 172.21.15.103:0/562737689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0f8a00 0x7f0a4c0fae50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 -- 172.21.15.103:0/562737689 >> 172.21.15.103:0/562737689 conn(0x7f0a4c0effa0 msgr2=0x7f0a4c0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 -- 172.21.15.103:0/562737689 shutdown_connections 2021-01-27T09:26:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.402+0000 7f0a515e7700 1 -- 172.21.15.103:0/562737689 wait complete. 2021-01-27T09:26:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 Processor -- start 2021-01-27T09:26:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- start start 2021-01-27T09:26:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c05f7d0 0x7f0a4c0f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 0x7f0a4c0f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0fb490 0x7f0a4c0f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0f50c0 con 0x7f0a4c05f7d0 2021-01-27T09:26:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0f5230 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c10f940 con 0x7f0a4c0fb490 2021-01-27T09:26:41.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 0x7f0a4c0f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:41.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a50de6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0fb490 0x7f0a4c0f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:41.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 0x7f0a4c0f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50276/0 (socket says 172.21.15.103:50276) 2021-01-27T09:26:41.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 -- 172.21.15.103:0/493188730 learned_addr learned my addr 172.21.15.103:0/493188730 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:41.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4bfff700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c05f7d0 0x7f0a4c0f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:41.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 -- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0fb490 msgr2=0x7f0a4c0f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0fb490 0x7f0a4c0f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 -- 172.21.15.103:0/493188730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c05f7d0 msgr2=0x7f0a4c0f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c05f7d0 0x7f0a4c0f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 -- 172.21.15.103:0/493188730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c10fb00 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a50de6700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a4c0fb490 0x7f0a4c0f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:26:41.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4bfff700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a4c05f7d0 0x7f0a4c0f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:41.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a4b7fe700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 0x7f0a4c0f4380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0a3c009c20 tx=0x7f0a3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:41.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00e030 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0a3c013a80 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c018070 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c10fd50 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c110100 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.406+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a4c05e310 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f0a3c013cf0 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0a3405bc70 0x7f0a3405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:41.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f0a3c077db0 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.425 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.47:6808/4157251446 conn(0x7f0a340655e0 0x7f0a34067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:41.425 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 --> v2:172.21.15.47:6808/4157251446 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a340680c0 con 0x7f0a340655e0 2021-01-27T09:26:41.425 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a3c0781b0 con 0x7f0a4c0f8a00 2021-01-27T09:26:41.425 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a4bfff700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0a3405bc70 0x7f0a3405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:41.426 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a50de6700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.47:6808/4157251446 conn(0x7f0a340655e0 0x7f0a34067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:41.426 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a4bfff700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0a3405bc70 0x7f0a3405e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0a4c0f5c90 tx=0x7f0a4000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:41.427 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.410+0000 7f0a50de6700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.47:6808/4157251446 conn(0x7f0a340655e0 0x7f0a34067a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:41.427 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.414+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== osd.6 v2:172.21.15.47:6808/4157251446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f0a340680c0 con 0x7f0a340655e0 2021-01-27T09:26:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.434+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 --> v2:172.21.15.47:6808/4157251446 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a4c057240 con 0x7f0a340655e0 2021-01-27T09:26:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.434+0000 7f0a48ff9700 1 -- 172.21.15.103:0/493188730 <== osd.6 v2:172.21.15.47:6808/4157251446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a4c057240 con 0x7f0a340655e0 2021-01-27T09:26:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 >> v2:172.21.15.47:6808/4157251446 conn(0x7f0a340655e0 msgr2=0x7f0a34067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.47:6808/4157251446 conn(0x7f0a340655e0 0x7f0a34067a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0a3405bc70 msgr2=0x7f0a3405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 --2- 172.21.15.103:0/493188730 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0a3405bc70 0x7f0a3405e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0a4c0f5c90 tx=0x7f0a4000b040).stop 2021-01-27T09:26:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 msgr2=0x7f0a4c0f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 --2- 172.21.15.103:0/493188730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a4c0f8a00 0x7f0a4c0f4380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0a3c009c20 tx=0x7f0a3c009b30).stop 2021-01-27T09:26:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a50de6700 1 -- 172.21.15.103:0/493188730 reap_dead start 2021-01-27T09:26:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 shutdown_connections 2021-01-27T09:26:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 >> 172.21.15.103:0/493188730 conn(0x7f0a4c0effa0 msgr2=0x7f0a4c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 shutdown_connections 2021-01-27T09:26:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:41.438+0000 7f0a515e7700 1 -- 172.21.15.103:0/493188730 wait complete. 2021-01-27T09:26:42.190 INFO:teuthology.orchestra.run.smithi103.stdout:176093659172 2021-01-27T09:26:42.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-01-27T09:26:42.348 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:42.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:42 smithi047 bash[9721]: cluster 2021-01-27T09:26:40.273248+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:42.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:42 smithi103 bash[9772]: cluster 2021-01-27T09:26:40.273248+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:42 smithi103 bash[13570]: cluster 2021-01-27T09:26:40.273248+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:44.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:44 smithi047 bash[9721]: cluster 2021-01-27T09:26:42.273955+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:44.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:43 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:44.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:44 smithi103 bash[9772]: cluster 2021-01-27T09:26:42.273955+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:44.398 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:43 smithi103 bash[10018]: debug 2021-01-27T09:26:43.978+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:44.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:44 smithi103 bash[13570]: cluster 2021-01-27T09:26:42.273955+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:45.292 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 -- 172.21.15.103:0/810335709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f4960 msgr2=0x7fd8200f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.292 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 --2- 172.21.15.103:0/810335709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f4960 0x7fd8200f4d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd810004d70 tx=0x7fd810009b30).stop 2021-01-27T09:26:45.292 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 -- 172.21.15.103:0/810335709 shutdown_connections 2021-01-27T09:26:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 --2- 172.21.15.103:0/810335709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8200f6550 0x7fd8200fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 --2- 172.21.15.103:0/810335709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f4960 0x7fd8200f4d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 --2- 172.21.15.103:0/810335709 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f5c00 0x7fd8200f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 -- 172.21.15.103:0/810335709 >> 172.21.15.103:0/810335709 conn(0x7fd8200f0160 msgr2=0x7fd8200f2580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:45.293 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 -- 172.21.15.103:0/810335709 shutdown_connections 2021-01-27T09:26:45.294 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.282+0000 7fd82563e700 1 -- 172.21.15.103:0/810335709 wait complete. 2021-01-27T09:26:45.296 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 Processor -- start 2021-01-27T09:26:45.296 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- start start 2021-01-27T09:26:45.296 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 0x7fd82005f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:45.297 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8200f5c00 0x7fd82010a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:45.297 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f6550 0x7fd82010cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:45.297 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 0x7fd82005f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:45.297 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82010d290 con 0x7fd8200f5c00 2021-01-27T09:26:45.297 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82010d400 con 0x7fd8200f6550 2021-01-27T09:26:45.298 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82010d5c0 con 0x7fd8200f4960 2021-01-27T09:26:45.298 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 0x7fd82005f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33048/0 (socket says 172.21.15.103:33048) 2021-01-27T09:26:45.298 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 -- 172.21.15.103:0/2091380730 learned_addr learned my addr 172.21.15.103:0/2091380730 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81f7fe700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f6550 0x7fd82010cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81e7fc700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8200f5c00 0x7fd82010a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 -- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f6550 msgr2=0x7fd82010cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f6550 0x7fd82010cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 -- 172.21.15.103:0/2091380730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8200f5c00 msgr2=0x7fd82010a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8200f5c00 0x7fd82010a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 -- 172.21.15.103:0/2091380730 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82010d780 con 0x7fd8200f4960 2021-01-27T09:26:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81f7fe700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8200f6550 0x7fd82010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:26:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd81effd700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 0x7fd82005f9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd81000b700 tx=0x7fd810009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81000e030 con 0x7fd8200f4960 2021-01-27T09:26:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fd810004100 con 0x7fd8200f4960 2021-01-27T09:26:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82010d9d0 con 0x7fd8200f4960 2021-01-27T09:26:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810018070 con 0x7fd8200f4960 2021-01-27T09:26:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.286+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82010de30 con 0x7fd8200f4960 2021-01-27T09:26:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd82005e6c0 con 0x7fd8200f4960 2021-01-27T09:26:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fd810013620 con 0x7fd8200f4960 2021-01-27T09:26:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd80c05bd20 0x7fd80c05e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fd810077540 con 0x7fd8200f4960 2021-01-27T09:26:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd81e7fc700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd80c05bd20 0x7fd80c05e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.47:6812/1597879315 conn(0x7fd80c065690 0x7fd80c067b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 --> v2:172.21.15.47:6812/1597879315 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd80c068170 con 0x7fd80c065690 2021-01-27T09:26:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd810079bb0 con 0x7fd8200f4960 2021-01-27T09:26:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd81f7fe700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.47:6812/1597879315 conn(0x7fd80c065690 0x7fd80c067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.290+0000 7fd81e7fc700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd80c05bd20 0x7fd80c05e1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd808009fd0 tx=0x7fd80800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.294+0000 7fd81f7fe700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.47:6812/1597879315 conn(0x7fd80c065690 0x7fd80c067b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.294+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== osd.7 v2:172.21.15.47:6812/1597879315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fd80c068170 con 0x7fd80c065690 2021-01-27T09:26:45.319 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.310+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 --> v2:172.21.15.47:6812/1597879315 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd820057240 con 0x7fd80c065690 2021-01-27T09:26:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd8177fe700 1 -- 172.21.15.103:0/2091380730 <== osd.7 v2:172.21.15.47:6812/1597879315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd820057240 con 0x7fd80c065690 2021-01-27T09:26:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 >> v2:172.21.15.47:6812/1597879315 conn(0x7fd80c065690 msgr2=0x7fd80c067b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.47:6812/1597879315 conn(0x7fd80c065690 0x7fd80c067b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd80c05bd20 msgr2=0x7fd80c05e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 --2- 172.21.15.103:0/2091380730 >> v2:172.21.15.103:6800/3303543367 conn(0x7fd80c05bd20 0x7fd80c05e1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd808009fd0 tx=0x7fd80800b040).stop 2021-01-27T09:26:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 msgr2=0x7fd82005f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 --2- 172.21.15.103:0/2091380730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8200f4960 0x7fd82005f9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd81000b700 tx=0x7fd810009b30).stop 2021-01-27T09:26:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd81f7fe700 1 -- 172.21.15.103:0/2091380730 reap_dead start 2021-01-27T09:26:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 shutdown_connections 2021-01-27T09:26:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 >> 172.21.15.103:0/2091380730 conn(0x7fd8200f0160 msgr2=0x7fd8200f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 shutdown_connections 2021-01-27T09:26:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:45.314+0000 7fd82563e700 1 -- 172.21.15.103:0/2091380730 wait complete. 2021-01-27T09:26:45.375 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:45 smithi103 bash[9772]: audit 2021-01-27T09:26:43.983613+0000 mgr.y (mgr.14138) 408 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:45.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:45 smithi103 bash[13570]: audit 2021-01-27T09:26:43.983613+0000 mgr.y (mgr.14138) 408 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:45.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:45 smithi047 bash[9721]: audit 2021-01-27T09:26:43.983613+0000 mgr.y (mgr.14138) 408 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:46.037 INFO:teuthology.orchestra.run.smithi103.stdout:206158430239 2021-01-27T09:26:46.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-01-27T09:26:46.187 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:46.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:46 smithi103 bash[9772]: cluster 2021-01-27T09:26:44.275021+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:46.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:46 smithi103 bash[13570]: cluster 2021-01-27T09:26:44.275021+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:46.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:46 smithi047 bash[9721]: cluster 2021-01-27T09:26:44.275021+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:48.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:48 smithi103 bash[9772]: cluster 2021-01-27T09:26:46.276208+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:48.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:48 smithi103 bash[13570]: cluster 2021-01-27T09:26:46.276208+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:48.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:48 smithi047 bash[9721]: cluster 2021-01-27T09:26:46.276208+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- 172.21.15.103:0/3980534884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f6760 msgr2=0x7f8a700f4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- 172.21.15.103:0/3980534884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f6760 0x7f8a700f4b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8a60004e00 tx=0x7f8a60009b30).stop 2021-01-27T09:26:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- 172.21.15.103:0/3980534884 shutdown_connections 2021-01-27T09:26:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- 172.21.15.103:0/3980534884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f51c0 0x7f8a700f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- 172.21.15.103:0/3980534884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700f5dc0 0x7f8a700f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.050 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- 172.21.15.103:0/3980534884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f6760 0x7f8a700f4b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.050 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- 172.21.15.103:0/3980534884 >> 172.21.15.103:0/3980534884 conn(0x7f8a700ef730 msgr2=0x7f8a700f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:49.050 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- 172.21.15.103:0/3980534884 shutdown_connections 2021-01-27T09:26:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- 172.21.15.103:0/3980534884 wait complete. 2021-01-27T09:26:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 Processor -- start 2021-01-27T09:26:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- start start 2021-01-27T09:26:49.052 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 0x7f8a700ff120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:49.052 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:49.052 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 0x7f8a700fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7010fbd0 con 0x7f8a700fdb50 2021-01-27T09:26:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7010fd40 con 0x7f8a700f51c0 2021-01-27T09:26:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a74898700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7010ff00 con 0x7f8a700f5dc0 2021-01-27T09:26:49.054 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a6e59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:49.054 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a6ed9d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 0x7f8a700ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:49.054 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.038+0000 7f8a6e59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33064/0 (socket says 172.21.15.103:33064) 2021-01-27T09:26:49.055 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6e59c700 1 -- 172.21.15.103:0/3392897273 learned_addr learned my addr 172.21.15.103:0/3392897273 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6f59e700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 0x7f8a700fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 -- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 msgr2=0x7f8a700fd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 -- 172.21.15.103:0/3392897273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 msgr2=0x7f8a700fdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 0x7f8a700fdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 -- 172.21.15.103:0/3392897273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a701100c0 con 0x7f8a700f51c0 2021-01-27T09:26:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6f59e700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 0x7f8a700fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6e59c700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:26:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a6ed9d700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 0x7f8a700ff120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8a640029a0 tx=0x7f8a64009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64009320 con 0x7f8a700f51c0 2021-01-27T09:26:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f8a6400f040 con 0x7f8a700f51c0 2021-01-27T09:26:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400d850 con 0x7f8a700f51c0 2021-01-27T09:26:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a70110370 con 0x7f8a700f51c0 2021-01-27T09:26:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a70110810 con 0x7f8a700f51c0 2021-01-27T09:26:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700f3320 con 0x7f8a700f51c0 2021-01-27T09:26:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.042+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f8a6400dc80 con 0x7f8a700f51c0 2021-01-27T09:26:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.046+0000 7f8a577fe700 1 --2- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 0x7f8a5805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.046+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f8a64075c90 con 0x7f8a700f51c0 2021-01-27T09:26:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.046+0000 7f8a6e59c700 1 --2- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 0x7f8a5805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.046+0000 7f8a6e59c700 1 --2- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 0x7f8a5805e130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8a60009c20 tx=0x7f8a60009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.050+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f8a64048810 con 0x7f8a700f51c0 2021-01-27T09:26:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a70100640 con 0x7f8a700f51c0 2021-01-27T09:26:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a577fe700 1 -- 172.21.15.103:0/3392897273 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a6404be30 con 0x7f8a700f51c0 2021-01-27T09:26:49.234 INFO:teuthology.orchestra.run.smithi103.stdout:42949673030 2021-01-27T09:26:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 msgr2=0x7f8a5805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 0x7f8a5805e130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8a60009c20 tx=0x7f8a60009b30).stop 2021-01-27T09:26:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 msgr2=0x7f8a700ff120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 0x7f8a700ff120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8a640029a0 tx=0x7f8a64009d60).stop 2021-01-27T09:26:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 shutdown_connections 2021-01-27T09:26:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> v2:172.21.15.103:6800/3303543367 conn(0x7f8a5805bc70 0x7f8a5805e130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a700fdb50 0x7f8a700fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a700f51c0 0x7f8a700ff120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 --2- 172.21.15.103:0/3392897273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a700f5dc0 0x7f8a700fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 >> 172.21.15.103:0/3392897273 conn(0x7f8a700ef730 msgr2=0x7f8a700f1840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:49.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 shutdown_connections 2021-01-27T09:26:49.239 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:49.226+0000 7f8a74898700 1 -- 172.21.15.103:0/3392897273 wait complete. 2021-01-27T09:26:49.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673025 got 42949673030 for osd.0 2021-01-27T09:26:49.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-01-27T09:26:50.068 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:50 smithi103 bash[13570]: cluster 2021-01-27T09:26:48.277078+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:50 smithi103 bash[13570]: audit 2021-01-27T09:26:49.230712+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.103:0/3392897273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T09:26:50.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:50 smithi103 bash[9772]: cluster 2021-01-27T09:26:48.277078+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:50.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:50 smithi103 bash[9772]: audit 2021-01-27T09:26:49.230712+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.103:0/3392897273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T09:26:50.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:50 smithi047 bash[9721]: cluster 2021-01-27T09:26:48.277078+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:50.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:50 smithi047 bash[9721]: audit 2021-01-27T09:26:49.230712+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.103:0/3392897273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T09:26:52.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:52 smithi103 bash[13570]: cluster 2021-01-27T09:26:50.278460+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:52.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:52 smithi103 bash[9772]: cluster 2021-01-27T09:26:50.278460+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:52.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:52 smithi047 bash[9721]: cluster 2021-01-27T09:26:50.278460+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:53.104 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/4031163376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f5a50 msgr2=0x7f12cc0f5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:53.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- 172.21.15.103:0/4031163376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f5a50 0x7f12cc0f5eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f12bc009df0 tx=0x7f12bc004d10).stop 2021-01-27T09:26:53.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/4031163376 shutdown_connections 2021-01-27T09:26:53.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- 172.21.15.103:0/4031163376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f63a0 0x7f12cc0fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.105 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- 172.21.15.103:0/4031163376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc0f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- 172.21.15.103:0/4031163376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f5a50 0x7f12cc0f5eb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/4031163376 >> 172.21.15.103:0/4031163376 conn(0x7f12cc0effb0 msgr2=0x7f12cc0f23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:53.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/4031163376 shutdown_connections 2021-01-27T09:26:53.106 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/4031163376 wait complete. 2021-01-27T09:26:53.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 Processor -- start 2021-01-27T09:26:53.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- start start 2021-01-27T09:26:53.108 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 0x7f12cc107f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f63a0 0x7f12cc108df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc109320 con 0x7f12cc0f5a50 2021-01-27T09:26:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc109490 con 0x7f12cc0f63a0 2021-01-27T09:26:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc109650 con 0x7f12cc0f47b0 2021-01-27T09:26:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33078/0 (socket says 172.21.15.103:33078) 2021-01-27T09:26:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d0fc6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f63a0 0x7f12cc108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 -- 172.21.15.103:0/497441684 learned_addr learned my addr 172.21.15.103:0/497441684 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cb7fe700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 0x7f12cc107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:53.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 -- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f63a0 msgr2=0x7f12cc108df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:53.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f63a0 0x7f12cc108df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 -- 172.21.15.103:0/497441684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 msgr2=0x7f12cc107f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:53.111 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 0x7f12cc107f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 -- 172.21.15.103:0/497441684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc109810 con 0x7f12cc0f47b0 2021-01-27T09:26:53.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cb7fe700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 0x7f12cc107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:53.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12cbfff700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f12b400eb90 tx=0x7f12b400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:53.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40092e0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.112 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f12b400f040 con 0x7f12cc0f47b0 2021-01-27T09:26:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc109ac0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400c910 con 0x7f12cc0f47b0 2021-01-27T09:26:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.098+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc1102d0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc0f3ba0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f12b401b030 con 0x7f12cc0f47b0 2021-01-27T09:26:53.115 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12c8ff9700 1 --2- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 0x7f12ac05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:53.116 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f12b4075a10 con 0x7f12cc0f47b0 2021-01-27T09:26:53.116 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12cb7fe700 1 --2- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 0x7f12ac05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:53.116 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.102+0000 7f12cb7fe700 1 --2- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 0x7f12ac05e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f12bc0076f0 tx=0x7f12bc004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:53.117 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.106+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f12b40487c0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12cc044bc0 con 0x7f12cc0f47b0 2021-01-27T09:26:53.277 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12c8ff9700 1 -- 172.21.15.103:0/497441684 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12b4019070 con 0x7f12cc0f47b0 2021-01-27T09:26:53.277 INFO:teuthology.orchestra.run.smithi103.stdout:68719476803 2021-01-27T09:26:53.279 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 msgr2=0x7f12ac05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 0x7f12ac05e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f12bc0076f0 tx=0x7f12bc004d10).stop 2021-01-27T09:26:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 msgr2=0x7f12cc107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f12b400eb90 tx=0x7f12b400b040).stop 2021-01-27T09:26:53.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 shutdown_connections 2021-01-27T09:26:53.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> v2:172.21.15.103:6800/3303543367 conn(0x7f12ac05bc70 0x7f12ac05e130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc0f63a0 0x7f12cc108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.281 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12cc0f47b0 0x7f12cc107a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 --2- 172.21.15.103:0/497441684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12cc0f5a50 0x7f12cc107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:53.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.270+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 >> 172.21.15.103:0/497441684 conn(0x7f12cc0effb0 msgr2=0x7f12cc0f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:53.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.274+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 shutdown_connections 2021-01-27T09:26:53.282 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:53.274+0000 7f12d17c7700 1 -- 172.21.15.103:0/497441684 wait complete. 2021-01-27T09:26:53.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476797 got 68719476803 for osd.1 2021-01-27T09:26:53.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-01-27T09:26:54.070 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:54.241 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:26:53 smithi103 bash[10018]: debug 2021-01-27T09:26:53.982+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:26:54.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:26:53 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:26:54.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:54 smithi047 bash[9721]: cluster 2021-01-27T09:26:52.279294+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:54.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:54 smithi047 bash[9721]: audit 2021-01-27T09:26:53.274576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.103:0/497441684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T09:26:54.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:54 smithi103 bash[9772]: cluster 2021-01-27T09:26:52.279294+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:54.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:54 smithi103 bash[9772]: audit 2021-01-27T09:26:53.274576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.103:0/497441684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T09:26:54.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:54 smithi103 bash[13570]: cluster 2021-01-27T09:26:52.279294+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:54.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:54 smithi103 bash[13570]: audit 2021-01-27T09:26:53.274576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.103:0/497441684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T09:26:55.464 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:55 smithi103 bash[13570]: audit 2021-01-27T09:26:53.989140+0000 mgr.y (mgr.14138) 414 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:55.465 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:55 smithi103 bash[9772]: audit 2021-01-27T09:26:53.989140+0000 mgr.y (mgr.14138) 414 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:55.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:55 smithi047 bash[9721]: audit 2021-01-27T09:26:53.989140+0000 mgr.y (mgr.14138) 414 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:26:56.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:56 smithi103 bash[9772]: cluster 2021-01-27T09:26:54.280402+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:56.328 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:56 smithi103 bash[13570]: cluster 2021-01-27T09:26:54.280402+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:56.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:56 smithi047 bash[9721]: cluster 2021-01-27T09:26:54.280402+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- 172.21.15.103:0/705965558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f6390 msgr2=0x7f05a00fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- 172.21.15.103:0/705965558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f6390 0x7f05a00fcc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0598009df0 tx=0x7f0598004d10).stop 2021-01-27T09:26:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- 172.21.15.103:0/705965558 shutdown_connections 2021-01-27T09:26:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- 172.21.15.103:0/705965558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f6390 0x7f05a00fcc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- 172.21.15.103:0/705965558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f47a0 0x7f05a00f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- 172.21.15.103:0/705965558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a00f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- 172.21.15.103:0/705965558 >> 172.21.15.103:0/705965558 conn(0x7f05a00effa0 msgr2=0x7f05a00f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- 172.21.15.103:0/705965558 shutdown_connections 2021-01-27T09:26:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- 172.21.15.103:0/705965558 wait complete. 2021-01-27T09:26:57.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 Processor -- start 2021-01-27T09:26:57.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- start start 2021-01-27T09:26:57.250 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 0x7f05a0107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a0107d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0109130 con 0x7f05a00f5a40 2021-01-27T09:26:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01092a0 con 0x7f05a00f6390 2021-01-27T09:26:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a748c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0109460 con 0x7f05a00f47a0 2021-01-27T09:26:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a6c8b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a648a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 0x7f05a0107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a6c8b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50336/0 (socket says 172.21.15.103:50336) 2021-01-27T09:26:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.238+0000 7f05a6c8b700 1 -- 172.21.15.103:0/2337143457 learned_addr learned my addr 172.21.15.103:0/2337143457 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:26:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a5c89700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a0107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:57.253 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 -- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 msgr2=0x7f05a0107820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:57.253 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 0x7f05a0107820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.253 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 -- 172.21.15.103:0/2337143457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 msgr2=0x7f05a0107d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:57.253 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a0107d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.253 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 -- 172.21.15.103:0/2337143457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0109620 con 0x7f05a00f6390 2021-01-27T09:26:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a648a700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 0x7f05a0107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:26:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a5c89700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:26:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a6c8b700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0598009fd0 tx=0x7f0598004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800e030 con 0x7f05a00f6390 2021-01-27T09:26:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f059800be80 con 0x7f05a00f6390 2021-01-27T09:26:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598018070 con 0x7f05a00f6390 2021-01-27T09:26:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a0109870 con 0x7f05a00f6390 2021-01-27T09:26:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a0110010 con 0x7f05a00f6390 2021-01-27T09:26:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a00f3b90 con 0x7f05a00f6390 2021-01-27T09:26:57.258 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f0598024060 con 0x7f05a00f6390 2021-01-27T09:26:57.258 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 --2- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 0x7f058c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:26:57.258 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f0598077760 con 0x7f05a00f6390 2021-01-27T09:26:57.258 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.242+0000 7f05a648a700 1 --2- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 0x7f058c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:26:57.258 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.246+0000 7f05a648a700 1 --2- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 0x7f058c05e130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f059c009fd0 tx=0x7f059c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:26:57.259 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.250+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f059804a3d0 con 0x7f05a00f6390 2021-01-27T09:26:57.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:57 smithi103 bash[13570]: cluster 2021-01-27T09:26:56.281505+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:57.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:57 smithi103 bash[9772]: cluster 2021-01-27T09:26:56.281505+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.414+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05a01105c0 con 0x7f05a00f6390 2021-01-27T09:26:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f0596ffd700 1 -- 172.21.15.103:0/2337143457 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f059804d9f0 con 0x7f05a00f6390 2021-01-27T09:26:57.425 INFO:teuthology.orchestra.run.smithi103.stdout:90194313278 2021-01-27T09:26:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 msgr2=0x7f058c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 0x7f058c05e130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f059c009fd0 tx=0x7f059c00b040).stop 2021-01-27T09:26:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 msgr2=0x7f05a0108c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:26:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0598009fd0 tx=0x7f0598004d10).stop 2021-01-27T09:26:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 shutdown_connections 2021-01-27T09:26:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> v2:172.21.15.103:6800/3303543367 conn(0x7f058c05bc70 0x7f058c05e130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05a00f6390 0x7f05a0108c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05a00f47a0 0x7f05a0107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 --2- 172.21.15.103:0/2337143457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05a00f5a40 0x7f05a0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:26:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 >> 172.21.15.103:0/2337143457 conn(0x7f05a00effa0 msgr2=0x7f05a005eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:26:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 shutdown_connections 2021-01-27T09:26:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:26:57.418+0000 7f05a748c700 1 -- 172.21.15.103:0/2337143457 wait complete. 2021-01-27T09:26:57.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:57 smithi047 bash[9721]: cluster 2021-01-27T09:26:56.281505+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:26:58.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313272 got 90194313278 for osd.2 2021-01-27T09:26:58.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-01-27T09:26:58.326 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:26:58.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:58 smithi047 bash[9721]: audit 2021-01-27T09:26:57.422073+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.103:0/2337143457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T09:26:58.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:58 smithi103 bash[13570]: audit 2021-01-27T09:26:57.422073+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.103:0/2337143457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T09:26:58.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:58 smithi103 bash[9772]: audit 2021-01-27T09:26:57.422073+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.103:0/2337143457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T09:26:59.554 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[13570]: cluster 2021-01-27T09:26:58.282164+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:59.554 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[13570]: audit 2021-01-27T09:26:58.341604+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:26:59.554 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[13570]: audit 2021-01-27T09:26:58.343435+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:26:59.555 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[9772]: cluster 2021-01-27T09:26:58.282164+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:59.555 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[9772]: audit 2021-01-27T09:26:58.341604+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:26:59.555 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:26:59 smithi103 bash[9772]: audit 2021-01-27T09:26:58.343435+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:26:59.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:59 smithi047 bash[9721]: cluster 2021-01-27T09:26:58.282164+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:26:59.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:59 smithi047 bash[9721]: audit 2021-01-27T09:26:58.341604+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:26:59.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:26:59 smithi047 bash[9721]: audit 2021-01-27T09:26:58.343435+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:27:01.324 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 -- 172.21.15.103:0/118128112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb98069420 msgr2=0x7fcb980698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:01.324 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 --2- 172.21.15.103:0/118128112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb98069420 0x7fcb980698a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcb94009dc0 tx=0x7fcb94004d10).stop 2021-01-27T09:27:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 -- 172.21.15.103:0/118128112 shutdown_connections 2021-01-27T09:27:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 --2- 172.21.15.103:0/118128112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb980fd850 0x7fcb980ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 --2- 172.21.15.103:0/118128112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb9806aa30 0x7fcb98068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 --2- 172.21.15.103:0/118128112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb98069420 0x7fcb980698a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 -- 172.21.15.103:0/118128112 >> 172.21.15.103:0/118128112 conn(0x7fcb980f10a0 msgr2=0x7fcb980f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.314+0000 7fcb9e186700 1 -- 172.21.15.103:0/118128112 shutdown_connections 2021-01-27T09:27:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- 172.21.15.103:0/118128112 wait complete. 2021-01-27T09:27:01.327 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 Processor -- start 2021-01-27T09:27:01.328 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- start start 2021-01-27T09:27:01.328 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 0x7fcb98107d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:01.328 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 0x7fcb98108220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:01.328 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:01.328 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98109600 con 0x7fcb98069420 2021-01-27T09:27:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98109770 con 0x7fcb9806aa30 2021-01-27T09:27:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98109930 con 0x7fcb980fd850 2021-01-27T09:27:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33110/0 (socket says 172.21.15.103:33110) 2021-01-27T09:27:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9c983700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 0x7fcb98108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 -- 172.21.15.103:0/3472138172 learned_addr learned my addr 172.21.15.103:0/3472138172 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d184700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 0x7fcb98107d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 -- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 msgr2=0x7fcb98108220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 0x7fcb98108220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 -- 172.21.15.103:0/3472138172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 msgr2=0x7fcb98107d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 0x7fcb98107d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 -- 172.21.15.103:0/3472138172 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98109af0 con 0x7fcb980fd850 2021-01-27T09:27:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d184700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 0x7fcb98107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:27:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9c983700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 0x7fcb98108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:27:01.332 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9d985700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fcb90002a50 tx=0x7fcb90009da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:01.332 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90009320 con 0x7fcb980fd850 2021-01-27T09:27:01.332 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fcb9000f040 con 0x7fcb980fd850 2021-01-27T09:27:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb98109da0 con 0x7fcb980fd850 2021-01-27T09:27:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000d850 con 0x7fcb980fd850 2021-01-27T09:27:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.318+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb981104f0 con 0x7fcb980fd850 2021-01-27T09:27:01.334 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb78004da0 con 0x7fcb980fd850 2021-01-27T09:27:01.334 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fcb9001b060 con 0x7fcb980fd850 2021-01-27T09:27:01.335 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb8dffb700 1 --2- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 0x7fcb8405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:01.335 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb9d184700 1 --2- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 0x7fcb8405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:01.335 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fcb90075660 con 0x7fcb980fd850 2021-01-27T09:27:01.335 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.322+0000 7fcb9d184700 1 --2- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 0x7fcb8405e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcb98107aa0 tx=0x7fcb8800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:01.337 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.330+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fcb90048350 con 0x7fcb980fd850 2021-01-27T09:27:01.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:01 smithi103 bash[13570]: cluster 2021-01-27T09:27:00.283478+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:01.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:01 smithi103 bash[9772]: cluster 2021-01-27T09:27:00.283478+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.494+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb78005470 con 0x7fcb980fd850 2021-01-27T09:27:01.503 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.494+0000 7fcb8dffb700 1 -- 172.21.15.103:0/3472138172 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb9004b970 con 0x7fcb980fd850 2021-01-27T09:27:01.503 INFO:teuthology.orchestra.run.smithi103.stdout:111669149753 2021-01-27T09:27:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 msgr2=0x7fcb8405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 0x7fcb8405e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcb98107aa0 tx=0x7fcb8800b040).stop 2021-01-27T09:27:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 msgr2=0x7fcb98109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fcb90002a50 tx=0x7fcb90009da0).stop 2021-01-27T09:27:01.506 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 shutdown_connections 2021-01-27T09:27:01.506 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> v2:172.21.15.103:6800/3303543367 conn(0x7fcb8405bc70 0x7fcb8405e130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.506 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb980fd850 0x7fcb98109030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb98069420 0x7fcb98107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 --2- 172.21.15.103:0/3472138172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb9806aa30 0x7fcb98108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 >> 172.21.15.103:0/3472138172 conn(0x7fcb980f10a0 msgr2=0x7fcb980f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 shutdown_connections 2021-01-27T09:27:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:01.498+0000 7fcb9e186700 1 -- 172.21.15.103:0/3472138172 wait complete. 2021-01-27T09:27:01.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:01 smithi047 bash[9721]: cluster 2021-01-27T09:27:00.283478+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:02.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149747 got 111669149753 for osd.3 2021-01-27T09:27:02.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-01-27T09:27:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:02.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:02 smithi103 bash[9772]: audit 2021-01-27T09:27:01.500797+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.103:0/3472138172' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T09:27:02.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:02 smithi103 bash[13570]: audit 2021-01-27T09:27:01.500797+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.103:0/3472138172' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T09:27:02.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:02 smithi047 bash[9721]: audit 2021-01-27T09:27:01.500797+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.103:0/3472138172' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T09:27:03.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:03 smithi103 bash[13570]: cluster 2021-01-27T09:27:02.284329+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:03.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:03 smithi103 bash[9772]: cluster 2021-01-27T09:27:02.284329+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:03.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:03 smithi047 bash[9721]: cluster 2021-01-27T09:27:02.284329+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:04.271 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:04 smithi103 bash[10018]: debug 2021-01-27T09:27:03.994+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:04.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:04.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:04 smithi103 bash[9772]: audit 2021-01-27T09:27:04.000534+0000 mgr.y (mgr.14138) 420 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:04.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:04 smithi103 bash[13570]: audit 2021-01-27T09:27:04.000534+0000 mgr.y (mgr.14138) 420 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:04.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:04 smithi047 bash[9721]: audit 2021-01-27T09:27:04.000534+0000 mgr.y (mgr.14138) 420 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:05.429 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/1215893971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 msgr2=0x7f391c0fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:05.430 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- 172.21.15.103:0/1215893971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0fd8a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3914009e10 tx=0x7f3914004d00).stop 2021-01-27T09:27:05.430 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/1215893971 shutdown_connections 2021-01-27T09:27:05.430 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- 172.21.15.103:0/1215893971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0fd8a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.430 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- 172.21.15.103:0/1215893971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c05f870 0x7f391c0f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.431 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- 172.21.15.103:0/1215893971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c0f8980 0x7f391c0fadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.431 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/1215893971 >> 172.21.15.103:0/1215893971 conn(0x7f391c0efee0 msgr2=0x7f391c0f2340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:05.431 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/1215893971 shutdown_connections 2021-01-27T09:27:05.431 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/1215893971 wait complete. 2021-01-27T09:27:05.433 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 Processor -- start 2021-01-27T09:27:05.433 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- start start 2021-01-27T09:27:05.433 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c05f870 0x7f391c0f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:05.433 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c0f8980 0x7f391c0f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:05.434 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:05.434 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0f5040 con 0x7f391c05f870 2021-01-27T09:27:05.434 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0f51b0 con 0x7f391c0f8980 2021-01-27T09:27:05.434 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c10f640 con 0x7f391c0fb410 2021-01-27T09:27:05.435 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:05.435 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f391bfff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c0f8980 0x7f391c0f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:05.435 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33124/0 (socket says 172.21.15.103:33124) 2021-01-27T09:27:05.435 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 -- 172.21.15.103:0/2266330948 learned_addr learned my addr 172.21.15.103:0/2266330948 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:05.437 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3920bb0700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c05f870 0x7f391c0f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:05.437 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 -- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c0f8980 msgr2=0x7f391c0f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:05.437 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c0f8980 0x7f391c0f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.438 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 -- 172.21.15.103:0/2266330948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c05f870 msgr2=0x7f391c0f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:05.438 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c05f870 0x7f391c0f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.438 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 -- 172.21.15.103:0/2266330948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c10f800 con 0x7f391c0fb410 2021-01-27T09:27:05.438 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39213b1700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3914009cb0 tx=0x7f3914004d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:05.438 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400e040 con 0x7f391c0fb410 2021-01-27T09:27:05.439 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3914015bf0 con 0x7f391c0fb410 2021-01-27T09:27:05.439 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391401eb40 con 0x7f391c0fb410 2021-01-27T09:27:05.439 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.422+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c10fa50 con 0x7f391c0fb410 2021-01-27T09:27:05.439 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c10fe00 con 0x7f391c0fb410 2021-01-27T09:27:05.440 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c0f3b10 con 0x7f391c0fb410 2021-01-27T09:27:05.440 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f3914028440 con 0x7f391c0fb410 2021-01-27T09:27:05.441 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f39197fa700 1 --2- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 0x7f390405e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:05.442 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f3914077fb0 con 0x7f391c0fb410 2021-01-27T09:27:05.442 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f3920bb0700 1 --2- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 0x7f390405e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:05.442 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.426+0000 7f3920bb0700 1 --2- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 0x7f390405e1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f391c0f5c10 tx=0x7f391000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:05.443 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.430+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f391404ac40 con 0x7f391c0fb410 2021-01-27T09:27:05.599 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.590+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f391c1005c0 con 0x7f391c0fb410 2021-01-27T09:27:05.600 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.590+0000 7f39197fa700 1 -- 172.21.15.103:0/2266330948 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f391404e260 con 0x7f391c0fb410 2021-01-27T09:27:05.600 INFO:teuthology.orchestra.run.smithi103.stdout:133143986227 2021-01-27T09:27:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 msgr2=0x7f390405e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 0x7f390405e1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f391c0f5c10 tx=0x7f391000b040).stop 2021-01-27T09:27:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 msgr2=0x7f391c0f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3914009cb0 tx=0x7f3914004d00).stop 2021-01-27T09:27:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 shutdown_connections 2021-01-27T09:27:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> v2:172.21.15.103:6800/3303543367 conn(0x7f390405bd10 0x7f390405e1d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f391c0fb410 0x7f391c0f4950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f391c05f870 0x7f391c0f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 --2- 172.21.15.103:0/2266330948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f391c0f8980 0x7f391c0f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 >> 172.21.15.103:0/2266330948 conn(0x7f391c0efee0 msgr2=0x7f391c0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 shutdown_connections 2021-01-27T09:27:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:05.594+0000 7f3921bb2700 1 -- 172.21.15.103:0/2266330948 wait complete. 2021-01-27T09:27:05.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:05 smithi103 bash[13570]: cluster 2021-01-27T09:27:04.285440+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:05.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:05 smithi103 bash[9772]: cluster 2021-01-27T09:27:04.285440+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:05.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:05 smithi047 bash[9721]: cluster 2021-01-27T09:27:04.285440+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:06.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986221 got 133143986227 for osd.4 2021-01-27T09:27:06.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-01-27T09:27:06.479 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:06.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:06 smithi103 bash[9772]: audit 2021-01-27T09:27:05.597644+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.103:0/2266330948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T09:27:06.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:06 smithi103 bash[13570]: audit 2021-01-27T09:27:05.597644+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.103:0/2266330948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T09:27:06.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:06 smithi047 bash[9721]: audit 2021-01-27T09:27:05.597644+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.103:0/2266330948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T09:27:07.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:07 smithi103 bash[13570]: cluster 2021-01-27T09:27:06.286653+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:07.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:07 smithi103 bash[9772]: cluster 2021-01-27T09:27:06.286653+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:07.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:07 smithi047 bash[9721]: cluster 2021-01-27T09:27:06.286653+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:09.381 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 -- 172.21.15.103:0/2088231220 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f58a0 msgr2=0x7eff180f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:09.381 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 --2- 172.21.15.103:0/2088231220 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f58a0 0x7eff180f5cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7eff14004e30 tx=0x7eff14009b30).stop 2021-01-27T09:27:09.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 -- 172.21.15.103:0/2088231220 shutdown_connections 2021-01-27T09:27:09.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 --2- 172.21.15.103:0/2088231220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f7490 0x7eff180fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 --2- 172.21.15.103:0/2088231220 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f58a0 0x7eff180f5cc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.383 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 --2- 172.21.15.103:0/2088231220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 0x7eff180f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.384 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 -- 172.21.15.103:0/2088231220 >> 172.21.15.103:0/2088231220 conn(0x7eff180f10a0 msgr2=0x7eff180f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:09.384 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 -- 172.21.15.103:0/2088231220 shutdown_connections 2021-01-27T09:27:09.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.374+0000 7eff1ea56700 1 -- 172.21.15.103:0/2088231220 wait complete. 2021-01-27T09:27:09.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 Processor -- start 2021-01-27T09:27:09.385 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- start start 2021-01-27T09:27:09.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:09.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 0x7eff18105e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:09.386 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f7490 0x7eff18106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:09.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18107220 con 0x7eff180f6b40 2021-01-27T09:27:09.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18107390 con 0x7eff180f58a0 2021-01-27T09:27:09.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18107550 con 0x7eff180f7490 2021-01-27T09:27:09.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:09.387 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1e255700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f7490 0x7eff18106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:09.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50376/0 (socket says 172.21.15.103:50376) 2021-01-27T09:27:09.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 -- 172.21.15.103:0/3066334162 learned_addr learned my addr 172.21.15.103:0/3066334162 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:09.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1d253700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 0x7eff18105e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:09.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 -- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f7490 msgr2=0x7eff18106cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:09.388 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f7490 0x7eff18106cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 -- 172.21.15.103:0/3066334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 msgr2=0x7eff18105e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:09.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 0x7eff18105e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 -- 172.21.15.103:0/3066334162 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18107710 con 0x7eff180f58a0 2021-01-27T09:27:09.389 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1da54700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7eff14005010 tx=0x7eff14009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:09.390 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e030 con 0x7eff180f58a0 2021-01-27T09:27:09.390 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18107960 con 0x7eff180f58a0 2021-01-27T09:27:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7eff14004160 con 0x7eff180f58a0 2021-01-27T09:27:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14018070 con 0x7eff180f58a0 2021-01-27T09:27:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1810e100 con 0x7eff180f58a0 2021-01-27T09:27:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.378+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff18107b20 con 0x7eff180f58a0 2021-01-27T09:27:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.382+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7eff1401d420 con 0x7eff180f58a0 2021-01-27T09:27:09.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.382+0000 7eff0e7fc700 1 --2- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 0x7eff0405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:09.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.382+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7eff14077b30 con 0x7eff180f58a0 2021-01-27T09:27:09.392 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.382+0000 7eff1d253700 1 --2- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 0x7eff0405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.382+0000 7eff1d253700 1 --2- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 0x7eff0405e130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7eff08009fd0 tx=0x7eff0800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.386+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7eff1404a890 con 0x7eff180f58a0 2021-01-27T09:27:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.550+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7eff180271d0 con 0x7eff180f58a0 2021-01-27T09:27:09.559 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.550+0000 7eff0e7fc700 1 -- 172.21.15.103:0/3066334162 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff1404deb0 con 0x7eff180f58a0 2021-01-27T09:27:09.559 INFO:teuthology.orchestra.run.smithi103.stdout:154618822703 2021-01-27T09:27:09.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 msgr2=0x7eff0405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:09.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 0x7eff0405e130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7eff08009fd0 tx=0x7eff0800b040).stop 2021-01-27T09:27:09.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 msgr2=0x7eff18105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:09.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7eff14005010 tx=0x7eff14009b30).stop 2021-01-27T09:27:09.561 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 shutdown_connections 2021-01-27T09:27:09.562 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> v2:172.21.15.103:6800/3303543367 conn(0x7eff0405bc70 0x7eff0405e130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.562 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff180f7490 0x7eff18106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.562 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff180f58a0 0x7eff18105910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.562 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 --2- 172.21.15.103:0/3066334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff180f6b40 0x7eff18105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:09.563 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 >> 172.21.15.103:0/3066334162 conn(0x7eff180f10a0 msgr2=0x7eff180f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:09.563 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 shutdown_connections 2021-01-27T09:27:09.563 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:09.554+0000 7eff1ea56700 1 -- 172.21.15.103:0/3066334162 wait complete. 2021-01-27T09:27:09.610 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:09 smithi103 bash[9772]: cluster 2021-01-27T09:27:08.287631+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:09.610 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:09 smithi103 bash[13570]: cluster 2021-01-27T09:27:08.287631+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:09.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:09 smithi047 bash[9721]: cluster 2021-01-27T09:27:08.287631+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:10.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822697 got 154618822703 for osd.5 2021-01-27T09:27:10.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-01-27T09:27:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:10.725 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:10 smithi103 bash[9772]: audit 2021-01-27T09:27:09.556866+0000 mon.a (mon.0) 656 : audit [DBG] from='client.? 172.21.15.103:0/3066334162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T09:27:10.726 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:10 smithi103 bash[13570]: audit 2021-01-27T09:27:09.556866+0000 mon.a (mon.0) 656 : audit [DBG] from='client.? 172.21.15.103:0/3066334162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T09:27:10.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:10 smithi047 bash[9721]: audit 2021-01-27T09:27:09.556866+0000 mon.a (mon.0) 656 : audit [DBG] from='client.? 172.21.15.103:0/3066334162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T09:27:11.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:11 smithi103 bash[9772]: cluster 2021-01-27T09:27:10.289037+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:11.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:11 smithi103 bash[13570]: cluster 2021-01-27T09:27:10.289037+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:11.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:11 smithi047 bash[9721]: cluster 2021-01-27T09:27:10.289037+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:13.488 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 -- 172.21.15.103:0/2797194834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f480f8a80 msgr2=0x7f7f480fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:13.488 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2797194834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f480f8a80 0x7f7f480fae70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7f38004e00 tx=0x7f7f38009b30).stop 2021-01-27T09:27:13.489 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 -- 172.21.15.103:0/2797194834 shutdown_connections 2021-01-27T09:27:13.489 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2797194834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 0x7f7f480fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.489 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2797194834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f4805f750 0x7f7f480f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.489 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2797194834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f480f8a80 0x7f7f480fae70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.490 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.478+0000 7f7f47fff700 1 -- 172.21.15.103:0/2797194834 >> 172.21.15.103:0/2797194834 conn(0x7f7f480effa0 msgr2=0x7f7f480f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:13.490 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- 172.21.15.103:0/2797194834 shutdown_connections 2021-01-27T09:27:13.490 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- 172.21.15.103:0/2797194834 wait complete. 2021-01-27T09:27:13.491 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 Processor -- start 2021-01-27T09:27:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- start start 2021-01-27T09:27:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 0x7f7f48105db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 0x7f7f48106ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481071d0 con 0x7f7f480fb490 2021-01-27T09:27:13.493 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48107340 con 0x7f7f480f8a80 2021-01-27T09:27:13.493 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48107500 con 0x7f7f4805f750 2021-01-27T09:27:13.493 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:13.493 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33148/0 (socket says 172.21.15.103:33148) 2021-01-27T09:27:13.494 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 -- 172.21.15.103:0/2691270642 learned_addr learned my addr 172.21.15.103:0/2691270642 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:13.494 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f467fc700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 0x7f7f48105db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:13.494 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f477fe700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 0x7f7f48106ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:13.494 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 -- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 msgr2=0x7f7f48105db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:13.494 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 0x7f7f48105db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.495 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 -- 172.21.15.103:0/2691270642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 msgr2=0x7f7f48106ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:13.495 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 0x7f7f48106ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.495 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 -- 172.21.15.103:0/2691270642 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f481076c0 con 0x7f7f4805f750 2021-01-27T09:27:13.495 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f467fc700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 0x7f7f48105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:27:13.495 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f46ffd700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7f3c00ebc0 tx=0x7f7f3c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:13.496 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0092e0 con 0x7f7f4805f750 2021-01-27T09:27:13.496 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7f3c00f040 con 0x7f7f4805f750 2021-01-27T09:27:13.496 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f48107970 con 0x7f7f4805f750 2021-01-27T09:27:13.496 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00c940 con 0x7f7f4805f750 2021-01-27T09:27:13.497 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.482+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4810e100 con 0x7f7f4805f750 2021-01-27T09:27:13.497 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f7f3c00cd30 con 0x7f7f4805f750 2021-01-27T09:27:13.498 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f480f3b90 con 0x7f7f4805f750 2021-01-27T09:27:13.498 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f2f7fe700 1 --2- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 0x7f7f3005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:13.498 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f7f3c075940 con 0x7f7f4805f750 2021-01-27T09:27:13.498 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f467fc700 1 --2- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 0x7f7f3005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:13.499 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.486+0000 7f7f467fc700 1 --2- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 0x7f7f3005e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7f3800b740 tx=0x7f7f38009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:13.502 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.494+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f7f3c048630 con 0x7f7f4805f750 2021-01-27T09:27:13.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:13 smithi103 bash[13570]: cluster 2021-01-27T09:27:12.289927+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:13.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:13 smithi103 bash[9772]: cluster 2021-01-27T09:27:12.289927+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:13.666 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.658+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7f481005b0 con 0x7f7f4805f750 2021-01-27T09:27:13.667 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.658+0000 7f7f2f7fe700 1 -- 172.21.15.103:0/2691270642 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f3c019090 con 0x7f7f4805f750 2021-01-27T09:27:13.668 INFO:teuthology.orchestra.run.smithi103.stdout:176093659178 2021-01-27T09:27:13.670 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 msgr2=0x7f7f3005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:13.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 0x7f7f3005e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7f3800b740 tx=0x7f7f38009b30).stop 2021-01-27T09:27:13.671 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 msgr2=0x7f7f481058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7f3c00ebc0 tx=0x7f7f3c00b040).stop 2021-01-27T09:27:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 shutdown_connections 2021-01-27T09:27:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> v2:172.21.15.103:6800/3303543367 conn(0x7f7f3005bc70 0x7f7f3005e130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f480fb490 0x7f7f48106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.672 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f4805f750 0x7f7f481058c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 --2- 172.21.15.103:0/2691270642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f480f8a80 0x7f7f48105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 >> 172.21.15.103:0/2691270642 conn(0x7f7f480effa0 msgr2=0x7f7f480fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 shutdown_connections 2021-01-27T09:27:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:13.662+0000 7f7f47fff700 1 -- 172.21.15.103:0/2691270642 wait complete. 2021-01-27T09:27:13.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:13 smithi047 bash[9721]: cluster 2021-01-27T09:27:12.289927+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:14.147 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:14 smithi103 bash[10018]: debug 2021-01-27T09:27:13.998+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:14.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:14.343 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659172 got 176093659178 for osd.6 2021-01-27T09:27:14.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-01-27T09:27:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:14.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:14 smithi103 bash[13570]: audit 2021-01-27T09:27:13.665068+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.103:0/2691270642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T09:27:14.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:14 smithi103 bash[13570]: audit 2021-01-27T09:27:14.004647+0000 mgr.y (mgr.14138) 426 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:14.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:14 smithi103 bash[9772]: audit 2021-01-27T09:27:13.665068+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.103:0/2691270642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T09:27:14.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:14 smithi103 bash[9772]: audit 2021-01-27T09:27:14.004647+0000 mgr.y (mgr.14138) 426 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:14.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:14 smithi047 bash[9721]: audit 2021-01-27T09:27:13.665068+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.103:0/2691270642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T09:27:14.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:14 smithi047 bash[9721]: audit 2021-01-27T09:27:14.004647+0000 mgr.y (mgr.14138) 426 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:15.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:15 smithi103 bash[13570]: cluster 2021-01-27T09:27:14.291034+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:15.666 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:15 smithi103 bash[9772]: cluster 2021-01-27T09:27:14.291034+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:15.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:15 smithi047 bash[9721]: cluster 2021-01-27T09:27:14.291034+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:17.455 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- 172.21.15.103:0/4282903367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f42e0 msgr2=0x7f0ad80f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:17.455 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 --2- 172.21.15.103:0/4282903367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f42e0 0x7f0ad80f9be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0ad0009e10 tx=0x7f0ad0004c50).stop 2021-01-27T09:27:17.455 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- 172.21.15.103:0/4282903367 shutdown_connections 2021-01-27T09:27:17.456 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 --2- 172.21.15.103:0/4282903367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f42e0 0x7f0ad80f9be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.456 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 --2- 172.21.15.103:0/4282903367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f4c20 0x7f0ad80f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.456 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 --2- 172.21.15.103:0/4282903367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad80f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.456 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- 172.21.15.103:0/4282903367 >> 172.21.15.103:0/4282903367 conn(0x7f0ad80ef730 msgr2=0x7f0ad80f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:17.457 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- 172.21.15.103:0/4282903367 shutdown_connections 2021-01-27T09:27:17.457 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- 172.21.15.103:0/4282903367 wait complete. 2021-01-27T09:27:17.459 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 Processor -- start 2021-01-27T09:27:17.459 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.450+0000 7f0adf493700 1 -- start start 2021-01-27T09:27:17.459 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:17.459 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 0x7f0ad810c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad810d570 con 0x7f0ad80f42e0 2021-01-27T09:27:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad810d6e0 con 0x7f0ad80f4c20 2021-01-27T09:27:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad810d8a0 con 0x7f0ad80f3970 2021-01-27T09:27:17.460 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:17.461 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adec92700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:17.461 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adec92700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50404/0 (socket says 172.21.15.103:50404) 2021-01-27T09:27:17.461 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33164/0 (socket says 172.21.15.103:33164) 2021-01-27T09:27:17.461 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adec92700 1 -- 172.21.15.103:0/1089601136 learned_addr learned my addr 172.21.15.103:0/1089601136 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0addc90700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 0x7f0ad810c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 -- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 msgr2=0x7f0ad810cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 -- 172.21.15.103:0/1089601136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 msgr2=0x7f0ad810c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:17.463 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 0x7f0ad810c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.463 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 -- 172.21.15.103:0/1089601136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad810da60 con 0x7f0ad80f3970 2021-01-27T09:27:17.463 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adec92700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:27:17.463 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0addc90700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 0x7f0ad810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:27:17.464 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0ade491700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0ad400ea90 tx=0x7f0ad400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:17.465 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40092e0 con 0x7f0ad80f3970 2021-01-27T09:27:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad810dcb0 con 0x7f0ad80f3970 2021-01-27T09:27:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81144e0 con 0x7f0ad80f3970 2021-01-27T09:27:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0ad400f040 con 0x7f0ad80f3970 2021-01-27T09:27:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400c840 con 0x7f0ad80f3970 2021-01-27T09:27:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac0004da0 con 0x7f0ad80f3970 2021-01-27T09:27:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f0ad400cbf0 con 0x7f0ad80f3970 2021-01-27T09:27:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 --2- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 0x7f0ac405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.454+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f0ad4075850 con 0x7f0ad80f3970 2021-01-27T09:27:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.458+0000 7f0addc90700 1 --2- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 0x7f0ac405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.458+0000 7f0addc90700 1 --2- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 0x7f0ac405e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0ac8004fc0 tx=0x7f0ac8009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.462+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f0ad40468c0 con 0x7f0ad80f3970 2021-01-27T09:27:17.628 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0ac0005470 con 0x7f0ad80f3970 2021-01-27T09:27:17.629 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0aceffd700 1 -- 172.21.15.103:0/1089601136 <== mon.1 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ad40484e0 con 0x7f0ad80f3970 2021-01-27T09:27:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:206158430245 2021-01-27T09:27:17.630 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 msgr2=0x7f0ac405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:17.631 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 0x7f0ac405e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0ac8004fc0 tx=0x7f0ac8009b30).stop 2021-01-27T09:27:17.631 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 msgr2=0x7f0ad810bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:17.631 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0ad400ea90 tx=0x7f0ad400b040).stop 2021-01-27T09:27:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 shutdown_connections 2021-01-27T09:27:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> v2:172.21.15.103:6800/3303543367 conn(0x7f0ac405bc70 0x7f0ac405e130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ad80f4c20 0x7f0ad810cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0ad80f3970 0x7f0ad810bd00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 --2- 172.21.15.103:0/1089601136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ad80f42e0 0x7f0ad810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 >> 172.21.15.103:0/1089601136 conn(0x7f0ad80ef730 msgr2=0x7f0ad80f0330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 shutdown_connections 2021-01-27T09:27:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:17.626+0000 7f0adf493700 1 -- 172.21.15.103:0/1089601136 wait complete. 2021-01-27T09:27:17.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:17 smithi103 bash[13570]: cluster 2021-01-27T09:27:16.292107+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:17.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:17 smithi103 bash[9772]: cluster 2021-01-27T09:27:16.292107+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:17.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:17 smithi047 bash[9721]: cluster 2021-01-27T09:27:16.292107+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:18.369 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430239 got 206158430245 for osd.7 2021-01-27T09:27:18.370 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-01-27T09:27:18.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T09:27:18.521 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:18.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:18 smithi103 bash[9772]: audit 2021-01-27T09:27:17.626939+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.103:0/1089601136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T09:27:18.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:18 smithi103 bash[13570]: audit 2021-01-27T09:27:17.626939+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.103:0/1089601136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T09:27:18.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:18 smithi047 bash[9721]: audit 2021-01-27T09:27:17.626939+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.103:0/1089601136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T09:27:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:19 smithi047 bash[9721]: cluster 2021-01-27T09:27:18.293060+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:19.820 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:19 smithi103 bash[13570]: cluster 2021-01-27T09:27:18.293060+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:19.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:19 smithi103 bash[9772]: cluster 2021-01-27T09:27:18.293060+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:21.475 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3721775697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc805f6d0 msgr2=0x7fbfc80f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:21.475 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3721775697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc805f6d0 0x7fbfc80f6270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbfb0004d40 tx=0x7fbfb0009b30).stop 2021-01-27T09:27:21.475 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3721775697 shutdown_connections 2021-01-27T09:27:21.476 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3721775697 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80f92a0 0x7fbfc80f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.476 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3721775697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc805f6d0 0x7fbfc80f6270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.476 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3721775697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc80f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.476 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3721775697 >> 172.21.15.103:0/3721775697 conn(0x7fbfc80effa0 msgr2=0x7fbfc80f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:21.476 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3721775697 shutdown_connections 2021-01-27T09:27:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3721775697 wait complete. 2021-01-27T09:27:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 Processor -- start 2021-01-27T09:27:21.479 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.470+0000 7fbfc7fff700 1 -- start start 2021-01-27T09:27:21.479 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc805f6d0 0x7fbfc810bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:21.479 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc810c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:21.479 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:21.480 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc810d7f0 con 0x7fbfc80f67f0 2021-01-27T09:27:21.480 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc810d960 con 0x7fbfc80f92a0 2021-01-27T09:27:21.480 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc810db20 con 0x7fbfc805f6d0 2021-01-27T09:27:21.480 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:21.481 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc805f6d0 0x7fbfc810bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:21.481 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50418/0 (socket says 172.21.15.103:50418) 2021-01-27T09:27:21.481 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 -- 172.21.15.103:0/3440409451 learned_addr learned my addr 172.21.15.103:0/3440409451 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:21.481 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc67fc700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc810c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:21.482 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 -- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc805f6d0 msgr2=0x7fbfc810bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:21.482 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc805f6d0 0x7fbfc810bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.482 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 -- 172.21.15.103:0/3440409451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 msgr2=0x7fbfc810c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:21.482 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc810c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.482 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 -- 172.21.15.103:0/3440409451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc810dce0 con 0x7fbfc80f92a0 2021-01-27T09:27:21.483 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc67fc700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:27:21.483 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc77fe700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fbfc000f280 tx=0x7fbfc0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:21.483 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0009940 con 0x7fbfc80f92a0 2021-01-27T09:27:21.483 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbfc000fe10 con 0x7fbfc80f92a0 2021-01-27T09:27:21.486 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc810df90 con 0x7fbfc80f92a0 2021-01-27T09:27:21.487 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0015420 con 0x7fbfc80f92a0 2021-01-27T09:27:21.487 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc81146d0 con 0x7fbfc80f92a0 2021-01-27T09:27:21.488 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.474+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80f3b90 con 0x7fbfc80f92a0 2021-01-27T09:27:21.488 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.478+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fbfc00090d0 con 0x7fbfc80f92a0 2021-01-27T09:27:21.490 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.478+0000 7fbfbf7fe700 1 --2- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 0x7fbfb405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:21.490 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.478+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fbfc0076880 con 0x7fbfc80f92a0 2021-01-27T09:27:21.491 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.478+0000 7fbfc6ffd700 1 --2- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 0x7fbfb405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:21.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.478+0000 7fbfc6ffd700 1 --2- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 0x7fbfb405e130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbfb0009d80 tx=0x7fbfb0009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:21.492 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.486+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fbfc00493e0 con 0x7fbfc80f92a0 2021-01-27T09:27:21.644 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.642+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfc8106c50 con 0x7fbfb405bc70 2021-01-27T09:27:21.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:21 smithi103 bash[13570]: cluster 2021-01-27T09:27:20.294452+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:21.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:21 smithi103 bash[9772]: cluster 2021-01-27T09:27:20.294452+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:21.665 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.662+0000 7fbfbf7fe700 1 -- 172.21.15.103:0/3440409451 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+346037 (secure 0 0 0) 0x7fbfc8106c50 con 0x7fbfb405bc70 2021-01-27T09:27:21.670 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:27:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 msgr2=0x7fbfb405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 0x7fbfb405e130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbfb0009d80 tx=0x7fbfb0009b30).stop 2021-01-27T09:27:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 msgr2=0x7fbfc810d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fbfc000f280 tx=0x7fbfc0004d10).stop 2021-01-27T09:27:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 shutdown_connections 2021-01-27T09:27:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> v2:172.21.15.103:6800/3303543367 conn(0x7fbfb405bc70 0x7fbfb405e130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80f92a0 0x7fbfc810d2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc805f6d0 0x7fbfc810bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 --2- 172.21.15.103:0/3440409451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfc80f67f0 0x7fbfc810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 >> 172.21.15.103:0/3440409451 conn(0x7fbfc80effa0 msgr2=0x7fbfc80f4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 shutdown_connections 2021-01-27T09:27:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:21.666+0000 7fbfc7fff700 1 -- 172.21.15.103:0/3440409451 wait complete. 2021-01-27T09:27:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2021-01-27T09:27:21.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:21 smithi047 bash[9721]: cluster 2021-01-27T09:27:20.294452+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2021-01-27T09:27:20.293355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1247,"num_read_kb":747,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":50812,"kb_used_data":6524,"kb_used_omap":0,"kb_used_meta":44224,"kb_avail":749910404,"statfs":{"total":767960285184,"available":767908253696,"internally_reserved":0,"allocated":6680576,"data_stored":1913014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45285376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006349"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215105+0000","last_change":"2021-01-27T09:24:42.795232+0000","last_active":"2021-01-27T09:24:58.215105+0000","last_peered":"2021-01-27T09:24:58.215105+0000","last_clean":"2021-01-27T09:24:58.215105+0000","last_became_active":"2021-01-27T09:24:42.794802+0000","last_became_peered":"2021-01-27T09:24:42.794802+0000","last_unstale":"2021-01-27T09:24:58.215105+0000","last_undegraded":"2021-01-27T09:24:58.215105+0000","last_fullsized":"2021-01-27T09:24:58.215105+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218678+0000","last_change":"2021-01-27T09:24:40.311727+0000","last_active":"2021-01-27T09:24:58.218678+0000","last_peered":"2021-01-27T09:24:58.218678+0000","last_clean":"2021-01-27T09:24:58.218678+0000","last_became_active":"2021-01-27T09:24:40.311319+0000","last_became_peered":"2021-01-27T09:24:40.311319+0000","last_unstale":"2021-01-27T09:24:58.218678+0000","last_undegraded":"2021-01-27T09:24:58.218678+0000","last_fullsized":"2021-01-27T09:24:58.218678+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211532+0000","last_change":"2021-01-27T09:24:22.339750+0000","last_active":"2021-01-27T09:24:58.211532+0000","last_peered":"2021-01-27T09:24:58.211532+0000","last_clean":"2021-01-27T09:24:58.211532+0000","last_became_active":"2021-01-27T09:24:22.338494+0000","last_became_peered":"2021-01-27T09:24:22.338494+0000","last_unstale":"2021-01-27T09:24:58.211532+0000","last_undegraded":"2021-01-27T09:24:58.211532+0000","last_fullsized":"2021-01-27T09:24:58.211532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"58'20","reported_seq":"52","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214882+0000","last_change":"2021-01-27T09:24:38.305362+0000","last_active":"2021-01-27T09:24:58.214882+0000","last_peered":"2021-01-27T09:24:58.214882+0000","last_clean":"2021-01-27T09:24:58.214882+0000","last_became_active":"2021-01-27T09:24:38.304992+0000","last_became_peered":"2021-01-27T09:24:38.304992+0000","last_unstale":"2021-01-27T09:24:58.214882+0000","last_undegraded":"2021-01-27T09:24:58.214882+0000","last_fullsized":"2021-01-27T09:24:58.214882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219540+0000","last_change":"2021-01-27T09:24:42.785792+0000","last_active":"2021-01-27T09:24:58.219540+0000","last_peered":"2021-01-27T09:24:58.219540+0000","last_clean":"2021-01-27T09:24:58.219540+0000","last_became_active":"2021-01-27T09:24:42.785440+0000","last_became_peered":"2021-01-27T09:24:42.785440+0000","last_unstale":"2021-01-27T09:24:58.219540+0000","last_undegraded":"2021-01-27T09:24:58.219540+0000","last_fullsized":"2021-01-27T09:24:58.219540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205580+0000","last_change":"2021-01-27T09:24:40.311156+0000","last_active":"2021-01-27T09:24:58.205580+0000","last_peered":"2021-01-27T09:24:58.205580+0000","last_clean":"2021-01-27T09:24:58.205580+0000","last_became_active":"2021-01-27T09:24:40.310726+0000","last_became_peered":"2021-01-27T09:24:40.310726+0000","last_unstale":"2021-01-27T09:24:58.205580+0000","last_undegraded":"2021-01-27T09:24:58.205580+0000","last_fullsized":"2021-01-27T09:24:58.205580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218199+0000","last_change":"2021-01-27T09:24:18.304726+0000","last_active":"2021-01-27T09:24:58.218199+0000","last_peered":"2021-01-27T09:24:58.218199+0000","last_clean":"2021-01-27T09:24:58.218199+0000","last_became_active":"2021-01-27T09:24:18.304311+0000","last_became_peered":"2021-01-27T09:24:18.304311+0000","last_unstale":"2021-01-27T09:24:58.218199+0000","last_undegraded":"2021-01-27T09:24:58.218199+0000","last_fullsized":"2021-01-27T09:24:58.218199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219018+0000","last_change":"2021-01-27T09:24:38.299940+0000","last_active":"2021-01-27T09:24:58.219018+0000","last_peered":"2021-01-27T09:24:58.219018+0000","last_clean":"2021-01-27T09:24:58.219018+0000","last_became_active":"2021-01-27T09:24:38.299407+0000","last_became_peered":"2021-01-27T09:24:38.299407+0000","last_unstale":"2021-01-27T09:24:58.219018+0000","last_undegraded":"2021-01-27T09:24:58.219018+0000","last_fullsized":"2021-01-27T09:24:58.219018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206827+0000","last_change":"2021-01-27T09:24:42.787399+0000","last_active":"2021-01-27T09:24:58.206827+0000","last_peered":"2021-01-27T09:24:58.206827+0000","last_clean":"2021-01-27T09:24:58.206827+0000","last_became_active":"2021-01-27T09:24:42.787011+0000","last_became_peered":"2021-01-27T09:24:42.787011+0000","last_unstale":"2021-01-27T09:24:58.206827+0000","last_undegraded":"2021-01-27T09:24:58.206827+0000","last_fullsized":"2021-01-27T09:24:58.206827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206697+0000","last_change":"2021-01-27T09:24:40.319483+0000","last_active":"2021-01-27T09:24:58.206697+0000","last_peered":"2021-01-27T09:24:58.206697+0000","last_clean":"2021-01-27T09:24:58.206697+0000","last_became_active":"2021-01-27T09:24:40.319020+0000","last_became_peered":"2021-01-27T09:24:40.319020+0000","last_unstale":"2021-01-27T09:24:58.206697+0000","last_undegraded":"2021-01-27T09:24:58.206697+0000","last_fullsized":"2021-01-27T09:24:58.206697+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"58'2","reported_seq":"56","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:10.058955+0000","last_change":"2021-01-27T09:24:22.543980+0000","last_active":"2021-01-27T09:27:10.058955+0000","last_peered":"2021-01-27T09:27:10.058955+0000","last_clean":"2021-01-27T09:27:10.058955+0000","last_became_active":"2021-01-27T09:24:22.336887+0000","last_became_peered":"2021-01-27T09:24:22.336887+0000","last_unstale":"2021-01-27T09:27:10.058955+0000","last_undegraded":"2021-01-27T09:27:10.058955+0000","last_fullsized":"2021-01-27T09:27:10.058955+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"58'6","reported_seq":"29","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219601+0000","last_change":"2021-01-27T09:24:38.300524+0000","last_active":"2021-01-27T09:24:58.219601+0000","last_peered":"2021-01-27T09:24:58.219601+0000","last_clean":"2021-01-27T09:24:58.219601+0000","last_became_active":"2021-01-27T09:24:38.299955+0000","last_became_peered":"2021-01-27T09:24:38.299955+0000","last_unstale":"2021-01-27T09:24:58.219601+0000","last_undegraded":"2021-01-27T09:24:58.219601+0000","last_fullsized":"2021-01-27T09:24:58.219601+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211376+0000","last_change":"2021-01-27T09:24:42.789559+0000","last_active":"2021-01-27T09:24:58.211376+0000","last_peered":"2021-01-27T09:24:58.211376+0000","last_clean":"2021-01-27T09:24:58.211376+0000","last_became_active":"2021-01-27T09:24:42.788973+0000","last_became_peered":"2021-01-27T09:24:42.788973+0000","last_unstale":"2021-01-27T09:24:58.211376+0000","last_undegraded":"2021-01-27T09:24:58.211376+0000","last_fullsized":"2021-01-27T09:24:58.211376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209804+0000","last_change":"2021-01-27T09:24:40.320466+0000","last_active":"2021-01-27T09:24:58.209804+0000","last_peered":"2021-01-27T09:24:58.209804+0000","last_clean":"2021-01-27T09:24:58.209804+0000","last_became_active":"2021-01-27T09:24:40.319919+0000","last_became_peered":"2021-01-27T09:24:40.319919+0000","last_unstale":"2021-01-27T09:24:58.209804+0000","last_undegraded":"2021-01-27T09:24:58.209804+0000","last_fullsized":"2021-01-27T09:24:58.209804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207520+0000","last_change":"2021-01-27T09:24:22.341651+0000","last_active":"2021-01-27T09:24:58.207520+0000","last_peered":"2021-01-27T09:24:58.207520+0000","last_clean":"2021-01-27T09:24:58.207520+0000","last_became_active":"2021-01-27T09:24:22.337739+0000","last_became_peered":"2021-01-27T09:24:22.337739+0000","last_unstale":"2021-01-27T09:24:58.207520+0000","last_undegraded":"2021-01-27T09:24:58.207520+0000","last_fullsized":"2021-01-27T09:24:58.207520+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"58'13","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219412+0000","last_change":"2021-01-27T09:24:38.295864+0000","last_active":"2021-01-27T09:24:58.219412+0000","last_peered":"2021-01-27T09:24:58.219412+0000","last_clean":"2021-01-27T09:24:58.219412+0000","last_became_active":"2021-01-27T09:24:38.295497+0000","last_became_peered":"2021-01-27T09:24:38.295497+0000","last_unstale":"2021-01-27T09:24:58.219412+0000","last_undegraded":"2021-01-27T09:24:58.219412+0000","last_fullsized":"2021-01-27T09:24:58.219412+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218020+0000","last_change":"2021-01-27T09:24:42.794006+0000","last_active":"2021-01-27T09:24:58.218020+0000","last_peered":"2021-01-27T09:24:58.218020+0000","last_clean":"2021-01-27T09:24:58.218020+0000","last_became_active":"2021-01-27T09:24:42.793682+0000","last_became_peered":"2021-01-27T09:24:42.793682+0000","last_unstale":"2021-01-27T09:24:58.218020+0000","last_undegraded":"2021-01-27T09:24:58.218020+0000","last_fullsized":"2021-01-27T09:24:58.218020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220056+0000","last_change":"2021-01-27T09:24:40.317442+0000","last_active":"2021-01-27T09:24:58.220056+0000","last_peered":"2021-01-27T09:24:58.220056+0000","last_clean":"2021-01-27T09:24:58.220056+0000","last_became_active":"2021-01-27T09:24:40.316758+0000","last_became_peered":"2021-01-27T09:24:40.316758+0000","last_unstale":"2021-01-27T09:24:58.220056+0000","last_undegraded":"2021-01-27T09:24:58.220056+0000","last_fullsized":"2021-01-27T09:24:58.220056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"45'1","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215193+0000","last_change":"2021-01-27T09:24:22.350527+0000","last_active":"2021-01-27T09:24:58.215193+0000","last_peered":"2021-01-27T09:24:58.215193+0000","last_clean":"2021-01-27T09:24:58.215193+0000","last_became_active":"2021-01-27T09:24:22.343041+0000","last_became_peered":"2021-01-27T09:24:22.343041+0000","last_unstale":"2021-01-27T09:24:58.215193+0000","last_undegraded":"2021-01-27T09:24:58.215193+0000","last_fullsized":"2021-01-27T09:24:58.215193+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"58'16","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.216180+0000","last_change":"2021-01-27T09:24:38.303708+0000","last_active":"2021-01-27T09:24:58.216180+0000","last_peered":"2021-01-27T09:24:58.216180+0000","last_clean":"2021-01-27T09:24:58.216180+0000","last_became_active":"2021-01-27T09:24:38.303350+0000","last_became_peered":"2021-01-27T09:24:38.303350+0000","last_unstale":"2021-01-27T09:24:58.216180+0000","last_undegraded":"2021-01-27T09:24:58.216180+0000","last_fullsized":"2021-01-27T09:24:58.216180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220381+0000","last_change":"2021-01-27T09:24:42.776726+0000","last_active":"2021-01-27T09:24:58.220381+0000","last_peered":"2021-01-27T09:24:58.220381+0000","last_clean":"2021-01-27T09:24:58.220381+0000","last_became_active":"2021-01-27T09:24:42.776292+0000","last_became_peered":"2021-01-27T09:24:42.776292+0000","last_unstale":"2021-01-27T09:24:58.220381+0000","last_undegraded":"2021-01-27T09:24:58.220381+0000","last_fullsized":"2021-01-27T09:24:58.220381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208014+0000","last_change":"2021-01-27T09:24:40.312895+0000","last_active":"2021-01-27T09:24:58.208014+0000","last_peered":"2021-01-27T09:24:58.208014+0000","last_clean":"2021-01-27T09:24:58.208014+0000","last_became_active":"2021-01-27T09:24:40.312495+0000","last_became_peered":"2021-01-27T09:24:40.312495+0000","last_unstale":"2021-01-27T09:24:58.208014+0000","last_undegraded":"2021-01-27T09:24:58.208014+0000","last_fullsized":"2021-01-27T09:24:58.208014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267913+0000","last_change":"2021-01-27T09:24:22.343663+0000","last_active":"2021-01-27T09:24:58.267913+0000","last_peered":"2021-01-27T09:24:58.267913+0000","last_clean":"2021-01-27T09:24:58.267913+0000","last_became_active":"2021-01-27T09:24:22.343252+0000","last_became_peered":"2021-01-27T09:24:22.343252+0000","last_unstale":"2021-01-27T09:24:58.267913+0000","last_undegraded":"2021-01-27T09:24:58.267913+0000","last_fullsized":"2021-01-27T09:24:58.267913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"58'15","reported_seq":"67","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.584367+0000","last_change":"2021-01-27T09:24:59.584367+0000","last_active":"2021-01-27T09:24:59.584367+0000","last_peered":"2021-01-27T09:24:59.584367+0000","last_clean":"2021-01-27T09:24:59.584367+0000","last_became_active":"2021-01-27T09:24:59.246576+0000","last_became_peered":"2021-01-27T09:24:59.246576+0000","last_unstale":"2021-01-27T09:24:59.584367+0000","last_undegraded":"2021-01-27T09:24:59.584367+0000","last_fullsized":"2021-01-27T09:24:59.584367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206915+0000","last_change":"2021-01-27T09:24:42.777682+0000","last_active":"2021-01-27T09:24:58.206915+0000","last_peered":"2021-01-27T09:24:58.206915+0000","last_clean":"2021-01-27T09:24:58.206915+0000","last_became_active":"2021-01-27T09:24:42.777310+0000","last_became_peered":"2021-01-27T09:24:42.777310+0000","last_unstale":"2021-01-27T09:24:58.206915+0000","last_undegraded":"2021-01-27T09:24:58.206915+0000","last_fullsized":"2021-01-27T09:24:58.206915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212465+0000","last_change":"2021-01-27T09:24:40.319194+0000","last_active":"2021-01-27T09:24:58.212465+0000","last_peered":"2021-01-27T09:24:58.212465+0000","last_clean":"2021-01-27T09:24:58.212465+0000","last_became_active":"2021-01-27T09:24:40.318798+0000","last_became_peered":"2021-01-27T09:24:40.318798+0000","last_unstale":"2021-01-27T09:24:58.212465+0000","last_undegraded":"2021-01-27T09:24:58.212465+0000","last_fullsized":"2021-01-27T09:24:58.212465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"49'2","reported_seq":"29","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214544+0000","last_change":"2021-01-27T09:24:18.298129+0000","last_active":"2021-01-27T09:24:58.214544+0000","last_peered":"2021-01-27T09:24:58.214544+0000","last_clean":"2021-01-27T09:24:58.214544+0000","last_became_active":"2021-01-27T09:24:18.297527+0000","last_became_peered":"2021-01-27T09:24:18.297527+0000","last_unstale":"2021-01-27T09:24:58.214544+0000","last_undegraded":"2021-01-27T09:24:58.214544+0000","last_fullsized":"2021-01-27T09:24:58.214544+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"58'17","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269128+0000","last_change":"2021-01-27T09:24:38.292489+0000","last_active":"2021-01-27T09:24:58.269128+0000","last_peered":"2021-01-27T09:24:58.269128+0000","last_clean":"2021-01-27T09:24:58.269128+0000","last_became_active":"2021-01-27T09:24:38.292060+0000","last_became_peered":"2021-01-27T09:24:38.292060+0000","last_unstale":"2021-01-27T09:24:58.269128+0000","last_undegraded":"2021-01-27T09:24:58.269128+0000","last_fullsized":"2021-01-27T09:24:58.269128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208677+0000","last_change":"2021-01-27T09:24:42.778838+0000","last_active":"2021-01-27T09:24:58.208677+0000","last_peered":"2021-01-27T09:24:58.208677+0000","last_clean":"2021-01-27T09:24:58.208677+0000","last_became_active":"2021-01-27T09:24:42.778342+0000","last_became_peered":"2021-01-27T09:24:42.778342+0000","last_unstale":"2021-01-27T09:24:58.208677+0000","last_undegraded":"2021-01-27T09:24:58.208677+0000","last_fullsized":"2021-01-27T09:24:58.208677+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323019+0000","last_change":"2021-01-27T09:24:40.310864+0000","last_active":"2021-01-27T09:27:11.323019+0000","last_peered":"2021-01-27T09:27:11.323019+0000","last_clean":"2021-01-27T09:27:11.323019+0000","last_became_active":"2021-01-27T09:24:40.309735+0000","last_became_peered":"2021-01-27T09:24:40.309735+0000","last_unstale":"2021-01-27T09:27:11.323019+0000","last_undegraded":"2021-01-27T09:27:11.323019+0000","last_fullsized":"2021-01-27T09:27:11.323019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"49'2","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206437+0000","last_change":"2021-01-27T09:24:22.340252+0000","last_active":"2021-01-27T09:24:58.206437+0000","last_peered":"2021-01-27T09:24:58.206437+0000","last_clean":"2021-01-27T09:24:58.206437+0000","last_became_active":"2021-01-27T09:24:22.339874+0000","last_became_peered":"2021-01-27T09:24:22.339874+0000","last_unstale":"2021-01-27T09:24:58.206437+0000","last_undegraded":"2021-01-27T09:24:58.206437+0000","last_fullsized":"2021-01-27T09:24:58.206437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212366+0000","last_change":"2021-01-27T09:24:38.630692+0000","last_active":"2021-01-27T09:24:58.212366+0000","last_peered":"2021-01-27T09:24:58.212366+0000","last_clean":"2021-01-27T09:24:58.212366+0000","last_became_active":"2021-01-27T09:24:38.629571+0000","last_became_peered":"2021-01-27T09:24:38.629571+0000","last_unstale":"2021-01-27T09:24:58.212366+0000","last_undegraded":"2021-01-27T09:24:58.212366+0000","last_fullsized":"2021-01-27T09:24:58.212366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215594+0000","last_change":"2021-01-27T09:24:42.794966+0000","last_active":"2021-01-27T09:24:58.215594+0000","last_peered":"2021-01-27T09:24:58.215594+0000","last_clean":"2021-01-27T09:24:58.215594+0000","last_became_active":"2021-01-27T09:24:42.794570+0000","last_became_peered":"2021-01-27T09:24:42.794570+0000","last_unstale":"2021-01-27T09:24:58.215594+0000","last_undegraded":"2021-01-27T09:24:58.215594+0000","last_fullsized":"2021-01-27T09:24:58.215594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206186+0000","last_change":"2021-01-27T09:24:40.324184+0000","last_active":"2021-01-27T09:24:58.206186+0000","last_peered":"2021-01-27T09:24:58.206186+0000","last_clean":"2021-01-27T09:24:58.206186+0000","last_became_active":"2021-01-27T09:24:40.321556+0000","last_became_peered":"2021-01-27T09:24:40.321556+0000","last_unstale":"2021-01-27T09:24:58.206186+0000","last_undegraded":"2021-01-27T09:24:58.206186+0000","last_fullsized":"2021-01-27T09:24:58.206186+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269269+0000","last_change":"2021-01-27T09:24:21.529791+0000","last_active":"2021-01-27T09:24:58.269269+0000","last_peered":"2021-01-27T09:24:58.269269+0000","last_clean":"2021-01-27T09:24:58.269269+0000","last_became_active":"2021-01-27T09:24:21.337365+0000","last_became_peered":"2021-01-27T09:24:21.337365+0000","last_unstale":"2021-01-27T09:24:58.269269+0000","last_undegraded":"2021-01-27T09:24:58.269269+0000","last_fullsized":"2021-01-27T09:24:58.269269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":56,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"58'14","reported_seq":"42","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214799+0000","last_change":"2021-01-27T09:24:38.630437+0000","last_active":"2021-01-27T09:24:58.214799+0000","last_peered":"2021-01-27T09:24:58.214799+0000","last_clean":"2021-01-27T09:24:58.214799+0000","last_became_active":"2021-01-27T09:24:38.629414+0000","last_became_peered":"2021-01-27T09:24:38.629414+0000","last_unstale":"2021-01-27T09:24:58.214799+0000","last_undegraded":"2021-01-27T09:24:58.214799+0000","last_fullsized":"2021-01-27T09:24:58.214799+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206264+0000","last_change":"2021-01-27T09:24:42.777689+0000","last_active":"2021-01-27T09:24:58.206264+0000","last_peered":"2021-01-27T09:24:58.206264+0000","last_clean":"2021-01-27T09:24:58.206264+0000","last_became_active":"2021-01-27T09:24:42.777348+0000","last_became_peered":"2021-01-27T09:24:42.777348+0000","last_unstale":"2021-01-27T09:24:58.206264+0000","last_undegraded":"2021-01-27T09:24:58.206264+0000","last_fullsized":"2021-01-27T09:24:58.206264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267646+0000","last_change":"2021-01-27T09:24:40.310829+0000","last_active":"2021-01-27T09:24:58.267646+0000","last_peered":"2021-01-27T09:24:58.267646+0000","last_clean":"2021-01-27T09:24:58.267646+0000","last_became_active":"2021-01-27T09:24:40.310248+0000","last_became_peered":"2021-01-27T09:24:40.310248+0000","last_unstale":"2021-01-27T09:24:58.267646+0000","last_undegraded":"2021-01-27T09:24:58.267646+0000","last_fullsized":"2021-01-27T09:24:58.267646+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"49'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210480+0000","last_change":"2021-01-27T09:24:18.295258+0000","last_active":"2021-01-27T09:24:58.210480+0000","last_peered":"2021-01-27T09:24:58.210480+0000","last_clean":"2021-01-27T09:24:58.210480+0000","last_became_active":"2021-01-27T09:24:18.294850+0000","last_became_peered":"2021-01-27T09:24:18.294850+0000","last_unstale":"2021-01-27T09:24:58.210480+0000","last_undegraded":"2021-01-27T09:24:58.210480+0000","last_fullsized":"2021-01-27T09:24:58.210480+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"58'12","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213870+0000","last_change":"2021-01-27T09:24:38.302289+0000","last_active":"2021-01-27T09:24:58.213870+0000","last_peered":"2021-01-27T09:24:58.213870+0000","last_clean":"2021-01-27T09:24:58.213870+0000","last_became_active":"2021-01-27T09:24:38.301888+0000","last_became_peered":"2021-01-27T09:24:38.301888+0000","last_unstale":"2021-01-27T09:24:58.213870+0000","last_undegraded":"2021-01-27T09:24:58.213870+0000","last_fullsized":"2021-01-27T09:24:58.213870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214345+0000","last_change":"2021-01-27T09:24:42.791070+0000","last_active":"2021-01-27T09:24:58.214345+0000","last_peered":"2021-01-27T09:24:58.214345+0000","last_clean":"2021-01-27T09:24:58.214345+0000","last_became_active":"2021-01-27T09:24:42.790767+0000","last_became_peered":"2021-01-27T09:24:42.790767+0000","last_unstale":"2021-01-27T09:24:58.214345+0000","last_undegraded":"2021-01-27T09:24:58.214345+0000","last_fullsized":"2021-01-27T09:24:58.214345+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206424+0000","last_change":"2021-01-27T09:24:40.311454+0000","last_active":"2021-01-27T09:24:58.206424+0000","last_peered":"2021-01-27T09:24:58.206424+0000","last_clean":"2021-01-27T09:24:58.206424+0000","last_became_active":"2021-01-27T09:24:40.309843+0000","last_became_peered":"2021-01-27T09:24:40.309843+0000","last_unstale":"2021-01-27T09:24:58.206424+0000","last_undegraded":"2021-01-27T09:24:58.206424+0000","last_fullsized":"2021-01-27T09:24:58.206424+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207437+0000","last_change":"2021-01-27T09:24:18.304189+0000","last_active":"2021-01-27T09:24:58.207437+0000","last_peered":"2021-01-27T09:24:58.207437+0000","last_clean":"2021-01-27T09:24:58.207437+0000","last_became_active":"2021-01-27T09:24:18.303700+0000","last_became_peered":"2021-01-27T09:24:18.303700+0000","last_unstale":"2021-01-27T09:24:58.207437+0000","last_undegraded":"2021-01-27T09:24:58.207437+0000","last_fullsized":"2021-01-27T09:24:58.207437+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"58'15","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220032+0000","last_change":"2021-01-27T09:24:38.300251+0000","last_active":"2021-01-27T09:24:58.220032+0000","last_peered":"2021-01-27T09:24:58.220032+0000","last_clean":"2021-01-27T09:24:58.220032+0000","last_became_active":"2021-01-27T09:24:38.299825+0000","last_became_peered":"2021-01-27T09:24:38.299825+0000","last_unstale":"2021-01-27T09:24:58.220032+0000","last_undegraded":"2021-01-27T09:24:58.220032+0000","last_fullsized":"2021-01-27T09:24:58.220032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210845+0000","last_change":"2021-01-27T09:24:42.789320+0000","last_active":"2021-01-27T09:24:58.210845+0000","last_peered":"2021-01-27T09:24:58.210845+0000","last_clean":"2021-01-27T09:24:58.210845+0000","last_became_active":"2021-01-27T09:24:42.788432+0000","last_became_peered":"2021-01-27T09:24:42.788432+0000","last_unstale":"2021-01-27T09:24:58.210845+0000","last_undegraded":"2021-01-27T09:24:58.210845+0000","last_fullsized":"2021-01-27T09:24:58.210845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215402+0000","last_change":"2021-01-27T09:24:40.310915+0000","last_active":"2021-01-27T09:24:58.215402+0000","last_peered":"2021-01-27T09:24:58.215402+0000","last_clean":"2021-01-27T09:24:58.215402+0000","last_became_active":"2021-01-27T09:24:40.310522+0000","last_became_peered":"2021-01-27T09:24:40.310522+0000","last_unstale":"2021-01-27T09:24:58.215402+0000","last_undegraded":"2021-01-27T09:24:58.215402+0000","last_fullsized":"2021-01-27T09:24:58.215402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.268477+0000","last_change":"2021-01-27T09:24:18.304639+0000","last_active":"2021-01-27T09:24:58.268477+0000","last_peered":"2021-01-27T09:24:58.268477+0000","last_clean":"2021-01-27T09:24:58.268477+0000","last_became_active":"2021-01-27T09:24:18.304145+0000","last_became_peered":"2021-01-27T09:24:18.304145+0000","last_unstale":"2021-01-27T09:24:58.268477+0000","last_undegraded":"2021-01-27T09:24:58.268477+0000","last_fullsized":"2021-01-27T09:24:58.268477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206405+0000","last_change":"2021-01-27T09:24:38.296997+0000","last_active":"2021-01-27T09:24:58.206405+0000","last_peered":"2021-01-27T09:24:58.206405+0000","last_clean":"2021-01-27T09:24:58.206405+0000","last_became_active":"2021-01-27T09:24:38.296276+0000","last_became_peered":"2021-01-27T09:24:38.296276+0000","last_unstale":"2021-01-27T09:24:58.206405+0000","last_undegraded":"2021-01-27T09:24:58.206405+0000","last_fullsized":"2021-01-27T09:24:58.206405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220873+0000","last_change":"2021-01-27T09:24:42.781219+0000","last_active":"2021-01-27T09:24:58.220873+0000","last_peered":"2021-01-27T09:24:58.220873+0000","last_clean":"2021-01-27T09:24:58.220873+0000","last_became_active":"2021-01-27T09:24:42.780869+0000","last_became_peered":"2021-01-27T09:24:42.780869+0000","last_unstale":"2021-01-27T09:24:58.220873+0000","last_undegraded":"2021-01-27T09:24:58.220873+0000","last_fullsized":"2021-01-27T09:24:58.220873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323797+0000","last_change":"2021-01-27T09:24:40.325006+0000","last_active":"2021-01-27T09:27:11.323797+0000","last_peered":"2021-01-27T09:27:11.323797+0000","last_clean":"2021-01-27T09:27:11.323797+0000","last_became_active":"2021-01-27T09:24:40.324634+0000","last_became_peered":"2021-01-27T09:24:40.324634+0000","last_unstale":"2021-01-27T09:27:11.323797+0000","last_undegraded":"2021-01-27T09:27:11.323797+0000","last_fullsized":"2021-01-27T09:27:11.323797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"49'1","reported_seq":"27","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217144+0000","last_change":"2021-01-27T09:24:18.301507+0000","last_active":"2021-01-27T09:24:58.217144+0000","last_peered":"2021-01-27T09:24:58.217144+0000","last_clean":"2021-01-27T09:24:58.217144+0000","last_became_active":"2021-01-27T09:24:18.296098+0000","last_became_peered":"2021-01-27T09:24:18.296098+0000","last_unstale":"2021-01-27T09:24:58.217144+0000","last_undegraded":"2021-01-27T09:24:58.217144+0000","last_fullsized":"2021-01-27T09:24:58.217144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"58'13","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210563+0000","last_change":"2021-01-27T09:24:38.631954+0000","last_active":"2021-01-27T09:24:58.210563+0000","last_peered":"2021-01-27T09:24:58.210563+0000","last_clean":"2021-01-27T09:24:58.210563+0000","last_became_active":"2021-01-27T09:24:38.631078+0000","last_became_peered":"2021-01-27T09:24:38.631078+0000","last_unstale":"2021-01-27T09:24:58.210563+0000","last_undegraded":"2021-01-27T09:24:58.210563+0000","last_fullsized":"2021-01-27T09:24:58.210563+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211630+0000","last_change":"2021-01-27T09:24:42.796360+0000","last_active":"2021-01-27T09:24:58.211630+0000","last_peered":"2021-01-27T09:24:58.211630+0000","last_clean":"2021-01-27T09:24:58.211630+0000","last_became_active":"2021-01-27T09:24:42.795966+0000","last_became_peered":"2021-01-27T09:24:42.795966+0000","last_unstale":"2021-01-27T09:24:58.211630+0000","last_undegraded":"2021-01-27T09:24:58.211630+0000","last_fullsized":"2021-01-27T09:24:58.211630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323099+0000","last_change":"2021-01-27T09:24:40.315281+0000","last_active":"2021-01-27T09:27:11.323099+0000","last_peered":"2021-01-27T09:27:11.323099+0000","last_clean":"2021-01-27T09:27:11.323099+0000","last_became_active":"2021-01-27T09:24:40.314904+0000","last_became_peered":"2021-01-27T09:24:40.314904+0000","last_unstale":"2021-01-27T09:27:11.323099+0000","last_undegraded":"2021-01-27T09:27:11.323099+0000","last_fullsized":"2021-01-27T09:27:11.323099+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207235+0000","last_change":"2021-01-27T09:24:22.356675+0000","last_active":"2021-01-27T09:24:58.207235+0000","last_peered":"2021-01-27T09:24:58.207235+0000","last_clean":"2021-01-27T09:24:58.207235+0000","last_became_active":"2021-01-27T09:24:22.339890+0000","last_became_peered":"2021-01-27T09:24:22.339890+0000","last_unstale":"2021-01-27T09:24:58.207235+0000","last_undegraded":"2021-01-27T09:24:58.207235+0000","last_fullsized":"2021-01-27T09:24:58.207235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"58'14","reported_seq":"69","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.263563+0000","last_change":"2021-01-27T09:24:59.263563+0000","last_active":"2021-01-27T09:24:59.263563+0000","last_peered":"2021-01-27T09:24:59.263563+0000","last_clean":"2021-01-27T09:24:59.263563+0000","last_became_active":"2021-01-27T09:24:59.244577+0000","last_became_peered":"2021-01-27T09:24:59.244577+0000","last_unstale":"2021-01-27T09:24:59.263563+0000","last_undegraded":"2021-01-27T09:24:59.263563+0000","last_fullsized":"2021-01-27T09:24:59.263563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7],"acting":[3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208415+0000","last_change":"2021-01-27T09:24:42.777040+0000","last_active":"2021-01-27T09:24:58.208415+0000","last_peered":"2021-01-27T09:24:58.208415+0000","last_clean":"2021-01-27T09:24:58.208415+0000","last_became_active":"2021-01-27T09:24:42.776314+0000","last_became_peered":"2021-01-27T09:24:42.776314+0000","last_unstale":"2021-01-27T09:24:58.208415+0000","last_undegraded":"2021-01-27T09:24:58.208415+0000","last_fullsized":"2021-01-27T09:24:58.208415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210256+0000","last_change":"2021-01-27T09:24:40.320927+0000","last_active":"2021-01-27T09:24:58.210256+0000","last_peered":"2021-01-27T09:24:58.210256+0000","last_clean":"2021-01-27T09:24:58.210256+0000","last_became_active":"2021-01-27T09:24:40.320538+0000","last_became_peered":"2021-01-27T09:24:40.320538+0000","last_unstale":"2021-01-27T09:24:58.210256+0000","last_undegraded":"2021-01-27T09:24:58.210256+0000","last_fullsized":"2021-01-27T09:24:58.210256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267639+0000","last_change":"2021-01-27T09:24:18.298203+0000","last_active":"2021-01-27T09:24:58.267639+0000","last_peered":"2021-01-27T09:24:58.267639+0000","last_clean":"2021-01-27T09:24:58.267639+0000","last_became_active":"2021-01-27T09:24:18.297785+0000","last_became_peered":"2021-01-27T09:24:18.297785+0000","last_unstale":"2021-01-27T09:24:58.267639+0000","last_undegraded":"2021-01-27T09:24:58.267639+0000","last_fullsized":"2021-01-27T09:24:58.267639+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"58'7","reported_seq":"28","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218210+0000","last_change":"2021-01-27T09:24:38.630716+0000","last_active":"2021-01-27T09:24:58.218210+0000","last_peered":"2021-01-27T09:24:58.218210+0000","last_clean":"2021-01-27T09:24:58.218210+0000","last_became_active":"2021-01-27T09:24:38.629694+0000","last_became_peered":"2021-01-27T09:24:38.629694+0000","last_unstale":"2021-01-27T09:24:58.218210+0000","last_undegraded":"2021-01-27T09:24:58.218210+0000","last_fullsized":"2021-01-27T09:24:58.218210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214270+0000","last_change":"2021-01-27T09:24:42.776005+0000","last_active":"2021-01-27T09:24:58.214270+0000","last_peered":"2021-01-27T09:24:58.214270+0000","last_clean":"2021-01-27T09:24:58.214270+0000","last_became_active":"2021-01-27T09:24:42.775642+0000","last_became_peered":"2021-01-27T09:24:42.775642+0000","last_unstale":"2021-01-27T09:24:58.214270+0000","last_undegraded":"2021-01-27T09:24:58.214270+0000","last_fullsized":"2021-01-27T09:24:58.214270+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218148+0000","last_change":"2021-01-27T09:24:40.308558+0000","last_active":"2021-01-27T09:24:58.218148+0000","last_peered":"2021-01-27T09:24:58.218148+0000","last_clean":"2021-01-27T09:24:58.218148+0000","last_became_active":"2021-01-27T09:24:40.308159+0000","last_became_peered":"2021-01-27T09:24:40.308159+0000","last_unstale":"2021-01-27T09:24:58.218148+0000","last_undegraded":"2021-01-27T09:24:58.218148+0000","last_fullsized":"2021-01-27T09:24:58.218148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212160+0000","last_change":"2021-01-27T09:24:18.312772+0000","last_active":"2021-01-27T09:24:58.212160+0000","last_peered":"2021-01-27T09:24:58.212160+0000","last_clean":"2021-01-27T09:24:58.212160+0000","last_became_active":"2021-01-27T09:24:18.312377+0000","last_became_peered":"2021-01-27T09:24:18.312377+0000","last_unstale":"2021-01-27T09:24:58.212160+0000","last_undegraded":"2021-01-27T09:24:58.212160+0000","last_fullsized":"2021-01-27T09:24:58.212160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"58'16","reported_seq":"47","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212126+0000","last_change":"2021-01-27T09:24:38.628517+0000","last_active":"2021-01-27T09:24:58.212126+0000","last_peered":"2021-01-27T09:24:58.212126+0000","last_clean":"2021-01-27T09:24:58.212126+0000","last_became_active":"2021-01-27T09:24:38.627443+0000","last_became_peered":"2021-01-27T09:24:38.627443+0000","last_unstale":"2021-01-27T09:24:58.212126+0000","last_undegraded":"2021-01-27T09:24:58.212126+0000","last_fullsized":"2021-01-27T09:24:58.212126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215484+0000","last_change":"2021-01-27T09:24:42.792701+0000","last_active":"2021-01-27T09:24:58.215484+0000","last_peered":"2021-01-27T09:24:58.215484+0000","last_clean":"2021-01-27T09:24:58.215484+0000","last_became_active":"2021-01-27T09:24:42.792213+0000","last_became_peered":"2021-01-27T09:24:42.792213+0000","last_unstale":"2021-01-27T09:24:58.215484+0000","last_undegraded":"2021-01-27T09:24:58.215484+0000","last_fullsized":"2021-01-27T09:24:58.215484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220707+0000","last_change":"2021-01-27T09:24:22.340639+0000","last_active":"2021-01-27T09:24:58.220707+0000","last_peered":"2021-01-27T09:24:58.220707+0000","last_clean":"2021-01-27T09:24:58.220707+0000","last_became_active":"2021-01-27T09:24:22.340155+0000","last_became_peered":"2021-01-27T09:24:22.340155+0000","last_unstale":"2021-01-27T09:24:58.220707+0000","last_undegraded":"2021-01-27T09:24:58.220707+0000","last_fullsized":"2021-01-27T09:24:58.220707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"58'15","reported_seq":"46","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219227+0000","last_change":"2021-01-27T09:24:38.307923+0000","last_active":"2021-01-27T09:24:58.219227+0000","last_peered":"2021-01-27T09:24:58.219227+0000","last_clean":"2021-01-27T09:24:58.219227+0000","last_became_active":"2021-01-27T09:24:38.307523+0000","last_became_peered":"2021-01-27T09:24:38.307523+0000","last_unstale":"2021-01-27T09:24:58.219227+0000","last_undegraded":"2021-01-27T09:24:58.219227+0000","last_fullsized":"2021-01-27T09:24:58.219227+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212327+0000","last_change":"2021-01-27T09:24:40.317978+0000","last_active":"2021-01-27T09:24:58.212327+0000","last_peered":"2021-01-27T09:24:58.212327+0000","last_clean":"2021-01-27T09:24:58.212327+0000","last_became_active":"2021-01-27T09:24:40.317404+0000","last_became_peered":"2021-01-27T09:24:40.317404+0000","last_unstale":"2021-01-27T09:24:58.212327+0000","last_undegraded":"2021-01-27T09:24:58.212327+0000","last_fullsized":"2021-01-27T09:24:58.212327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210953+0000","last_change":"2021-01-27T09:24:42.793057+0000","last_active":"2021-01-27T09:24:58.210953+0000","last_peered":"2021-01-27T09:24:58.210953+0000","last_clean":"2021-01-27T09:24:58.210953+0000","last_became_active":"2021-01-27T09:24:42.792693+0000","last_became_peered":"2021-01-27T09:24:42.792693+0000","last_unstale":"2021-01-27T09:24:58.210953+0000","last_undegraded":"2021-01-27T09:24:58.210953+0000","last_fullsized":"2021-01-27T09:24:58.210953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209771+0000","last_change":"2021-01-27T09:24:22.333743+0000","last_active":"2021-01-27T09:24:58.209771+0000","last_peered":"2021-01-27T09:24:58.209771+0000","last_clean":"2021-01-27T09:24:58.209771+0000","last_became_active":"2021-01-27T09:24:22.333212+0000","last_became_peered":"2021-01-27T09:24:22.333212+0000","last_unstale":"2021-01-27T09:24:58.209771+0000","last_undegraded":"2021-01-27T09:24:58.209771+0000","last_fullsized":"2021-01-27T09:24:58.209771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206590+0000","last_change":"2021-01-27T09:24:38.303258+0000","last_active":"2021-01-27T09:24:58.206590+0000","last_peered":"2021-01-27T09:24:58.206590+0000","last_clean":"2021-01-27T09:24:58.206590+0000","last_became_active":"2021-01-27T09:24:38.302390+0000","last_became_peered":"2021-01-27T09:24:38.302390+0000","last_unstale":"2021-01-27T09:24:58.206590+0000","last_undegraded":"2021-01-27T09:24:58.206590+0000","last_fullsized":"2021-01-27T09:24:58.206590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323345+0000","last_change":"2021-01-27T09:24:40.309812+0000","last_active":"2021-01-27T09:27:11.323345+0000","last_peered":"2021-01-27T09:27:11.323345+0000","last_clean":"2021-01-27T09:27:11.323345+0000","last_became_active":"2021-01-27T09:24:40.309262+0000","last_became_peered":"2021-01-27T09:24:40.309262+0000","last_unstale":"2021-01-27T09:27:11.323345+0000","last_undegraded":"2021-01-27T09:27:11.323345+0000","last_fullsized":"2021-01-27T09:27:11.323345+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218330+0000","last_change":"2021-01-27T09:24:42.784858+0000","last_active":"2021-01-27T09:24:58.218330+0000","last_peered":"2021-01-27T09:24:58.218330+0000","last_clean":"2021-01-27T09:24:58.218330+0000","last_became_active":"2021-01-27T09:24:42.784432+0000","last_became_peered":"2021-01-27T09:24:42.784432+0000","last_unstale":"2021-01-27T09:24:58.218330+0000","last_undegraded":"2021-01-27T09:24:58.218330+0000","last_fullsized":"2021-01-27T09:24:58.218330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207352+0000","last_change":"2021-01-27T09:24:18.293578+0000","last_active":"2021-01-27T09:24:58.207352+0000","last_peered":"2021-01-27T09:24:58.207352+0000","last_clean":"2021-01-27T09:24:58.207352+0000","last_became_active":"2021-01-27T09:24:18.292971+0000","last_became_peered":"2021-01-27T09:24:18.292971+0000","last_unstale":"2021-01-27T09:24:58.207352+0000","last_undegraded":"2021-01-27T09:24:58.207352+0000","last_fullsized":"2021-01-27T09:24:58.207352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"58'25","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209920+0000","last_change":"2021-01-27T09:24:38.296684+0000","last_active":"2021-01-27T09:24:58.209920+0000","last_peered":"2021-01-27T09:24:58.209920+0000","last_clean":"2021-01-27T09:24:58.209920+0000","last_became_active":"2021-01-27T09:24:38.296322+0000","last_became_peered":"2021-01-27T09:24:38.296322+0000","last_unstale":"2021-01-27T09:24:58.209920+0000","last_undegraded":"2021-01-27T09:24:58.209920+0000","last_fullsized":"2021-01-27T09:24:58.209920+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217485+0000","last_change":"2021-01-27T09:24:40.312836+0000","last_active":"2021-01-27T09:24:58.217485+0000","last_peered":"2021-01-27T09:24:58.217485+0000","last_clean":"2021-01-27T09:24:58.217485+0000","last_became_active":"2021-01-27T09:24:40.312422+0000","last_became_peered":"2021-01-27T09:24:40.312422+0000","last_unstale":"2021-01-27T09:24:58.217485+0000","last_undegraded":"2021-01-27T09:24:58.217485+0000","last_fullsized":"2021-01-27T09:24:58.217485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208662+0000","last_change":"2021-01-27T09:24:42.787229+0000","last_active":"2021-01-27T09:24:58.208662+0000","last_peered":"2021-01-27T09:24:58.208662+0000","last_clean":"2021-01-27T09:24:58.208662+0000","last_became_active":"2021-01-27T09:24:42.786852+0000","last_became_peered":"2021-01-27T09:24:42.786852+0000","last_unstale":"2021-01-27T09:24:58.208662+0000","last_undegraded":"2021-01-27T09:24:58.208662+0000","last_fullsized":"2021-01-27T09:24:58.208662+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"58'5","reported_seq":"172","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:18.251583+0000","last_change":"2021-01-27T09:24:37.280106+0000","last_active":"2021-01-27T09:27:18.251583+0000","last_peered":"2021-01-27T09:27:18.251583+0000","last_clean":"2021-01-27T09:27:18.251583+0000","last_became_active":"2021-01-27T09:24:37.279679+0000","last_became_peered":"2021-01-27T09:24:37.279679+0000","last_unstale":"2021-01-27T09:27:18.251583+0000","last_undegraded":"2021-01-27T09:27:18.251583+0000","last_fullsized":"2021-01-27T09:27:18.251583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212205+0000","last_change":"2021-01-27T09:24:18.305354+0000","last_active":"2021-01-27T09:24:58.212205+0000","last_peered":"2021-01-27T09:24:58.212205+0000","last_clean":"2021-01-27T09:24:58.212205+0000","last_became_active":"2021-01-27T09:24:18.304993+0000","last_became_peered":"2021-01-27T09:24:18.304993+0000","last_unstale":"2021-01-27T09:24:58.212205+0000","last_undegraded":"2021-01-27T09:24:58.212205+0000","last_fullsized":"2021-01-27T09:24:58.212205+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'15","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207706+0000","last_change":"2021-01-27T09:24:38.299461+0000","last_active":"2021-01-27T09:24:58.207706+0000","last_peered":"2021-01-27T09:24:58.207706+0000","last_clean":"2021-01-27T09:24:58.207706+0000","last_became_active":"2021-01-27T09:24:38.297793+0000","last_became_peered":"2021-01-27T09:24:38.297793+0000","last_unstale":"2021-01-27T09:24:58.207706+0000","last_undegraded":"2021-01-27T09:24:58.207706+0000","last_fullsized":"2021-01-27T09:24:58.207706+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212903+0000","last_change":"2021-01-27T09:24:40.322661+0000","last_active":"2021-01-27T09:24:58.212903+0000","last_peered":"2021-01-27T09:24:58.212903+0000","last_clean":"2021-01-27T09:24:58.212903+0000","last_became_active":"2021-01-27T09:24:40.322233+0000","last_became_peered":"2021-01-27T09:24:40.322233+0000","last_unstale":"2021-01-27T09:24:58.212903+0000","last_undegraded":"2021-01-27T09:24:58.212903+0000","last_fullsized":"2021-01-27T09:24:58.212903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210272+0000","last_change":"2021-01-27T09:24:42.787602+0000","last_active":"2021-01-27T09:24:58.210272+0000","last_peered":"2021-01-27T09:24:58.210272+0000","last_clean":"2021-01-27T09:24:58.210272+0000","last_became_active":"2021-01-27T09:24:42.787218+0000","last_became_peered":"2021-01-27T09:24:42.787218+0000","last_unstale":"2021-01-27T09:24:58.210272+0000","last_undegraded":"2021-01-27T09:24:58.210272+0000","last_fullsized":"2021-01-27T09:24:58.210272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"18","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214593+0000","last_change":"2021-01-27T09:24:37.286130+0000","last_active":"2021-01-27T09:24:58.214593+0000","last_peered":"2021-01-27T09:24:58.214593+0000","last_clean":"2021-01-27T09:24:58.214593+0000","last_became_active":"2021-01-27T09:24:37.285384+0000","last_became_peered":"2021-01-27T09:24:37.285384+0000","last_unstale":"2021-01-27T09:24:58.214593+0000","last_undegraded":"2021-01-27T09:24:58.214593+0000","last_fullsized":"2021-01-27T09:24:58.214593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209594+0000","last_change":"2021-01-27T09:24:22.338687+0000","last_active":"2021-01-27T09:24:58.209594+0000","last_peered":"2021-01-27T09:24:58.209594+0000","last_clean":"2021-01-27T09:24:58.209594+0000","last_became_active":"2021-01-27T09:24:22.338252+0000","last_became_peered":"2021-01-27T09:24:22.338252+0000","last_unstale":"2021-01-27T09:24:58.209594+0000","last_undegraded":"2021-01-27T09:24:58.209594+0000","last_fullsized":"2021-01-27T09:24:58.209594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205854+0000","last_change":"2021-01-27T09:24:22.341733+0000","last_active":"2021-01-27T09:24:58.205854+0000","last_peered":"2021-01-27T09:24:58.205854+0000","last_clean":"2021-01-27T09:24:58.205854+0000","last_became_active":"2021-01-27T09:24:22.341302+0000","last_became_peered":"2021-01-27T09:24:22.341302+0000","last_unstale":"2021-01-27T09:24:58.205854+0000","last_undegraded":"2021-01-27T09:24:58.205854+0000","last_fullsized":"2021-01-27T09:24:58.205854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:19:51.511232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:19:51.511232+0000","last_clean_scrub_stamp":"2021-01-27T09:19:51.511232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"58'15","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.268833+0000","last_change":"2021-01-27T09:24:38.633243+0000","last_active":"2021-01-27T09:24:58.268833+0000","last_peered":"2021-01-27T09:24:58.268833+0000","last_clean":"2021-01-27T09:24:58.268833+0000","last_became_active":"2021-01-27T09:24:38.632759+0000","last_became_peered":"2021-01-27T09:24:38.632759+0000","last_unstale":"2021-01-27T09:24:58.268833+0000","last_undegraded":"2021-01-27T09:24:58.268833+0000","last_fullsized":"2021-01-27T09:24:58.268833+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208546+0000","last_change":"2021-01-27T09:24:40.327138+0000","last_active":"2021-01-27T09:24:58.208546+0000","last_peered":"2021-01-27T09:24:58.208546+0000","last_clean":"2021-01-27T09:24:58.208546+0000","last_became_active":"2021-01-27T09:24:40.326696+0000","last_became_peered":"2021-01-27T09:24:40.326696+0000","last_unstale":"2021-01-27T09:24:58.208546+0000","last_undegraded":"2021-01-27T09:24:58.208546+0000","last_fullsized":"2021-01-27T09:24:58.208546+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207820+0000","last_change":"2021-01-27T09:24:42.785508+0000","last_active":"2021-01-27T09:24:58.207820+0000","last_peered":"2021-01-27T09:24:58.207820+0000","last_clean":"2021-01-27T09:24:58.207820+0000","last_became_active":"2021-01-27T09:24:42.785088+0000","last_became_peered":"2021-01-27T09:24:42.785088+0000","last_unstale":"2021-01-27T09:24:58.207820+0000","last_undegraded":"2021-01-27T09:24:58.207820+0000","last_fullsized":"2021-01-27T09:24:58.207820+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"18","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217841+0000","last_change":"2021-01-27T09:24:37.288205+0000","last_active":"2021-01-27T09:24:58.217841+0000","last_peered":"2021-01-27T09:24:58.217841+0000","last_clean":"2021-01-27T09:24:58.217841+0000","last_became_active":"2021-01-27T09:24:37.287744+0000","last_became_peered":"2021-01-27T09:24:37.287744+0000","last_unstale":"2021-01-27T09:24:58.217841+0000","last_undegraded":"2021-01-27T09:24:58.217841+0000","last_fullsized":"2021-01-27T09:24:58.217841+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205908+0000","last_change":"2021-01-27T09:24:22.340916+0000","last_active":"2021-01-27T09:24:58.205908+0000","last_peered":"2021-01-27T09:24:58.205908+0000","last_clean":"2021-01-27T09:24:58.205908+0000","last_became_active":"2021-01-27T09:24:22.340344+0000","last_became_peered":"2021-01-27T09:24:22.340344+0000","last_unstale":"2021-01-27T09:24:58.205908+0000","last_undegraded":"2021-01-27T09:24:58.205908+0000","last_fullsized":"2021-01-27T09:24:58.205908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"58'16","reported_seq":"74","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.612695+0000","last_change":"2021-01-27T09:24:59.612695+0000","last_active":"2021-01-27T09:24:59.612695+0000","last_peered":"2021-01-27T09:24:59.612695+0000","last_clean":"2021-01-27T09:24:59.612695+0000","last_became_active":"2021-01-27T09:24:59.248817+0000","last_became_peered":"2021-01-27T09:24:59.248817+0000","last_unstale":"2021-01-27T09:24:59.612695+0000","last_undegraded":"2021-01-27T09:24:59.612695+0000","last_fullsized":"2021-01-27T09:24:59.612695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":630,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210572+0000","last_change":"2021-01-27T09:24:40.316548+0000","last_active":"2021-01-27T09:24:58.210572+0000","last_peered":"2021-01-27T09:24:58.210572+0000","last_clean":"2021-01-27T09:24:58.210572+0000","last_became_active":"2021-01-27T09:24:40.316165+0000","last_became_peered":"2021-01-27T09:24:40.316165+0000","last_unstale":"2021-01-27T09:24:58.210572+0000","last_undegraded":"2021-01-27T09:24:58.210572+0000","last_fullsized":"2021-01-27T09:24:58.210572+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205369+0000","last_change":"2021-01-27T09:24:42.779068+0000","last_active":"2021-01-27T09:24:58.205369+0000","last_peered":"2021-01-27T09:24:58.205369+0000","last_clean":"2021-01-27T09:24:58.205369+0000","last_became_active":"2021-01-27T09:24:42.778704+0000","last_became_peered":"2021-01-27T09:24:42.778704+0000","last_unstale":"2021-01-27T09:24:58.205369+0000","last_undegraded":"2021-01-27T09:24:58.205369+0000","last_fullsized":"2021-01-27T09:24:58.205369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208809+0000","last_change":"2021-01-27T09:24:22.339379+0000","last_active":"2021-01-27T09:24:58.208809+0000","last_peered":"2021-01-27T09:24:58.208809+0000","last_clean":"2021-01-27T09:24:58.208809+0000","last_became_active":"2021-01-27T09:24:22.337561+0000","last_became_peered":"2021-01-27T09:24:22.337561+0000","last_unstale":"2021-01-27T09:24:58.208809+0000","last_undegraded":"2021-01-27T09:24:58.208809+0000","last_fullsized":"2021-01-27T09:24:58.208809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"58'21","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217032+0000","last_change":"2021-01-27T09:24:38.632702+0000","last_active":"2021-01-27T09:24:58.217032+0000","last_peered":"2021-01-27T09:24:58.217032+0000","last_clean":"2021-01-27T09:24:58.217032+0000","last_became_active":"2021-01-27T09:24:38.631610+0000","last_became_peered":"2021-01-27T09:24:38.631610+0000","last_unstale":"2021-01-27T09:24:58.217032+0000","last_undegraded":"2021-01-27T09:24:58.217032+0000","last_fullsized":"2021-01-27T09:24:58.217032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267772+0000","last_change":"2021-01-27T09:24:40.316040+0000","last_active":"2021-01-27T09:24:58.267772+0000","last_peered":"2021-01-27T09:24:58.267772+0000","last_clean":"2021-01-27T09:24:58.267772+0000","last_became_active":"2021-01-27T09:24:40.313324+0000","last_became_peered":"2021-01-27T09:24:40.313324+0000","last_unstale":"2021-01-27T09:24:58.267772+0000","last_undegraded":"2021-01-27T09:24:58.267772+0000","last_fullsized":"2021-01-27T09:24:58.267772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220083+0000","last_change":"2021-01-27T09:24:42.788240+0000","last_active":"2021-01-27T09:24:58.220083+0000","last_peered":"2021-01-27T09:24:58.220083+0000","last_clean":"2021-01-27T09:24:58.220083+0000","last_became_active":"2021-01-27T09:24:42.787595+0000","last_became_peered":"2021-01-27T09:24:42.787595+0000","last_unstale":"2021-01-27T09:24:58.220083+0000","last_undegraded":"2021-01-27T09:24:58.220083+0000","last_fullsized":"2021-01-27T09:24:58.220083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207316+0000","last_change":"2021-01-27T09:24:21.329375+0000","last_active":"2021-01-27T09:24:58.207316+0000","last_peered":"2021-01-27T09:24:58.207316+0000","last_clean":"2021-01-27T09:24:58.207316+0000","last_became_active":"2021-01-27T09:24:21.328834+0000","last_became_peered":"2021-01-27T09:24:21.328834+0000","last_unstale":"2021-01-27T09:24:58.207316+0000","last_undegraded":"2021-01-27T09:24:58.207316+0000","last_fullsized":"2021-01-27T09:24:58.207316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"58'22","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213723+0000","last_change":"2021-01-27T09:24:38.633762+0000","last_active":"2021-01-27T09:24:58.213723+0000","last_peered":"2021-01-27T09:24:58.213723+0000","last_clean":"2021-01-27T09:24:58.213723+0000","last_became_active":"2021-01-27T09:24:38.632507+0000","last_became_peered":"2021-01-27T09:24:38.632507+0000","last_unstale":"2021-01-27T09:24:58.213723+0000","last_undegraded":"2021-01-27T09:24:58.213723+0000","last_fullsized":"2021-01-27T09:24:58.213723+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219413+0000","last_change":"2021-01-27T09:24:40.313175+0000","last_active":"2021-01-27T09:24:58.219413+0000","last_peered":"2021-01-27T09:24:58.219413+0000","last_clean":"2021-01-27T09:24:58.219413+0000","last_became_active":"2021-01-27T09:24:40.312483+0000","last_became_peered":"2021-01-27T09:24:40.312483+0000","last_unstale":"2021-01-27T09:24:58.219413+0000","last_undegraded":"2021-01-27T09:24:58.219413+0000","last_fullsized":"2021-01-27T09:24:58.219413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207358+0000","last_change":"2021-01-27T09:24:42.777912+0000","last_active":"2021-01-27T09:24:58.207358+0000","last_peered":"2021-01-27T09:24:58.207358+0000","last_clean":"2021-01-27T09:24:58.207358+0000","last_became_active":"2021-01-27T09:24:42.777540+0000","last_became_peered":"2021-01-27T09:24:42.777540+0000","last_unstale":"2021-01-27T09:24:58.207358+0000","last_undegraded":"2021-01-27T09:24:58.207358+0000","last_fullsized":"2021-01-27T09:24:58.207358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269398+0000","last_change":"2021-01-27T09:24:22.343498+0000","last_active":"2021-01-27T09:24:58.269398+0000","last_peered":"2021-01-27T09:24:58.269398+0000","last_clean":"2021-01-27T09:24:58.269398+0000","last_became_active":"2021-01-27T09:24:22.342471+0000","last_became_peered":"2021-01-27T09:24:22.342471+0000","last_unstale":"2021-01-27T09:24:58.269398+0000","last_undegraded":"2021-01-27T09:24:58.269398+0000","last_fullsized":"2021-01-27T09:24:58.269398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"58'20","reported_seq":"50","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219164+0000","last_change":"2021-01-27T09:24:38.292564+0000","last_active":"2021-01-27T09:24:58.219164+0000","last_peered":"2021-01-27T09:24:58.219164+0000","last_clean":"2021-01-27T09:24:58.219164+0000","last_became_active":"2021-01-27T09:24:38.292081+0000","last_became_peered":"2021-01-27T09:24:38.292081+0000","last_unstale":"2021-01-27T09:24:58.219164+0000","last_undegraded":"2021-01-27T09:24:58.219164+0000","last_fullsized":"2021-01-27T09:24:58.219164+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323573+0000","last_change":"2021-01-27T09:24:40.313222+0000","last_active":"2021-01-27T09:27:11.323573+0000","last_peered":"2021-01-27T09:27:11.323573+0000","last_clean":"2021-01-27T09:27:11.323573+0000","last_became_active":"2021-01-27T09:24:40.312883+0000","last_became_peered":"2021-01-27T09:24:40.312883+0000","last_unstale":"2021-01-27T09:27:11.323573+0000","last_undegraded":"2021-01-27T09:27:11.323573+0000","last_fullsized":"2021-01-27T09:27:11.323573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215825+0000","last_change":"2021-01-27T09:24:42.793948+0000","last_active":"2021-01-27T09:24:58.215825+0000","last_peered":"2021-01-27T09:24:58.215825+0000","last_clean":"2021-01-27T09:24:58.215825+0000","last_became_active":"2021-01-27T09:24:42.793603+0000","last_became_peered":"2021-01-27T09:24:42.793603+0000","last_unstale":"2021-01-27T09:24:58.215825+0000","last_undegraded":"2021-01-27T09:24:58.215825+0000","last_fullsized":"2021-01-27T09:24:58.215825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210501+0000","last_change":"2021-01-27T09:24:40.320901+0000","last_active":"2021-01-27T09:24:58.210501+0000","last_peered":"2021-01-27T09:24:58.210501+0000","last_clean":"2021-01-27T09:24:58.210501+0000","last_became_active":"2021-01-27T09:24:40.320432+0000","last_became_peered":"2021-01-27T09:24:40.320432+0000","last_unstale":"2021-01-27T09:24:58.210501+0000","last_undegraded":"2021-01-27T09:24:58.210501+0000","last_fullsized":"2021-01-27T09:24:58.210501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205960+0000","last_change":"2021-01-27T09:24:22.339193+0000","last_active":"2021-01-27T09:24:58.205960+0000","last_peered":"2021-01-27T09:24:58.205960+0000","last_clean":"2021-01-27T09:24:58.205960+0000","last_became_active":"2021-01-27T09:24:22.338701+0000","last_became_peered":"2021-01-27T09:24:22.338701+0000","last_unstale":"2021-01-27T09:24:58.205960+0000","last_undegraded":"2021-01-27T09:24:58.205960+0000","last_fullsized":"2021-01-27T09:24:58.205960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"58'15","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220288+0000","last_change":"2021-01-27T09:24:38.298903+0000","last_active":"2021-01-27T09:24:58.220288+0000","last_peered":"2021-01-27T09:24:58.220288+0000","last_clean":"2021-01-27T09:24:58.220288+0000","last_became_active":"2021-01-27T09:24:38.298528+0000","last_became_peered":"2021-01-27T09:24:38.298528+0000","last_unstale":"2021-01-27T09:24:58.220288+0000","last_undegraded":"2021-01-27T09:24:58.220288+0000","last_fullsized":"2021-01-27T09:24:58.220288+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209936+0000","last_change":"2021-01-27T09:24:42.783494+0000","last_active":"2021-01-27T09:24:58.209936+0000","last_peered":"2021-01-27T09:24:58.209936+0000","last_clean":"2021-01-27T09:24:58.209936+0000","last_became_active":"2021-01-27T09:24:42.783113+0000","last_became_peered":"2021-01-27T09:24:42.783113+0000","last_unstale":"2021-01-27T09:24:58.209936+0000","last_undegraded":"2021-01-27T09:24:58.209936+0000","last_fullsized":"2021-01-27T09:24:58.209936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.322811+0000","last_change":"2021-01-27T09:24:40.315373+0000","last_active":"2021-01-27T09:27:11.322811+0000","last_peered":"2021-01-27T09:27:11.322811+0000","last_clean":"2021-01-27T09:27:11.322811+0000","last_became_active":"2021-01-27T09:24:40.314979+0000","last_became_peered":"2021-01-27T09:24:40.314979+0000","last_unstale":"2021-01-27T09:27:11.322811+0000","last_undegraded":"2021-01-27T09:27:11.322811+0000","last_fullsized":"2021-01-27T09:27:11.322811+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205888+0000","last_change":"2021-01-27T09:24:22.333175+0000","last_active":"2021-01-27T09:24:58.205888+0000","last_peered":"2021-01-27T09:24:58.205888+0000","last_clean":"2021-01-27T09:24:58.205888+0000","last_became_active":"2021-01-27T09:24:22.332657+0000","last_became_peered":"2021-01-27T09:24:22.332657+0000","last_unstale":"2021-01-27T09:24:58.205888+0000","last_undegraded":"2021-01-27T09:24:58.205888+0000","last_fullsized":"2021-01-27T09:24:58.205888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"58'17","reported_seq":"46","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208116+0000","last_change":"2021-01-27T09:24:38.303648+0000","last_active":"2021-01-27T09:24:58.208116+0000","last_peered":"2021-01-27T09:24:58.208116+0000","last_clean":"2021-01-27T09:24:58.208116+0000","last_became_active":"2021-01-27T09:24:38.303107+0000","last_became_peered":"2021-01-27T09:24:38.303107+0000","last_unstale":"2021-01-27T09:24:58.208116+0000","last_undegraded":"2021-01-27T09:24:58.208116+0000","last_fullsized":"2021-01-27T09:24:58.208116+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220535+0000","last_change":"2021-01-27T09:24:42.780897+0000","last_active":"2021-01-27T09:24:58.220535+0000","last_peered":"2021-01-27T09:24:58.220535+0000","last_clean":"2021-01-27T09:24:58.220535+0000","last_became_active":"2021-01-27T09:24:42.780487+0000","last_became_peered":"2021-01-27T09:24:42.780487+0000","last_unstale":"2021-01-27T09:24:58.220535+0000","last_undegraded":"2021-01-27T09:24:58.220535+0000","last_fullsized":"2021-01-27T09:24:58.220535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323232+0000","last_change":"2021-01-27T09:24:40.325088+0000","last_active":"2021-01-27T09:27:11.323232+0000","last_peered":"2021-01-27T09:27:11.323232+0000","last_clean":"2021-01-27T09:27:11.323232+0000","last_became_active":"2021-01-27T09:24:40.324601+0000","last_became_peered":"2021-01-27T09:24:40.324601+0000","last_unstale":"2021-01-27T09:27:11.323232+0000","last_undegraded":"2021-01-27T09:27:11.323232+0000","last_fullsized":"2021-01-27T09:27:11.323232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"45'1","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205446+0000","last_change":"2021-01-27T09:24:22.347978+0000","last_active":"2021-01-27T09:24:58.205446+0000","last_peered":"2021-01-27T09:24:58.205446+0000","last_clean":"2021-01-27T09:24:58.205446+0000","last_became_active":"2021-01-27T09:24:22.333068+0000","last_became_peered":"2021-01-27T09:24:22.333068+0000","last_unstale":"2021-01-27T09:24:58.205446+0000","last_undegraded":"2021-01-27T09:24:58.205446+0000","last_fullsized":"2021-01-27T09:24:58.205446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"58'13","reported_seq":"38","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219839+0000","last_change":"2021-01-27T09:24:38.300331+0000","last_active":"2021-01-27T09:24:58.219839+0000","last_peered":"2021-01-27T09:24:58.219839+0000","last_clean":"2021-01-27T09:24:58.219839+0000","last_became_active":"2021-01-27T09:24:38.299986+0000","last_became_peered":"2021-01-27T09:24:38.299986+0000","last_unstale":"2021-01-27T09:24:58.219839+0000","last_undegraded":"2021-01-27T09:24:58.219839+0000","last_fullsized":"2021-01-27T09:24:58.219839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213812+0000","last_change":"2021-01-27T09:24:42.786403+0000","last_active":"2021-01-27T09:24:58.213812+0000","last_peered":"2021-01-27T09:24:58.213812+0000","last_clean":"2021-01-27T09:24:58.213812+0000","last_became_active":"2021-01-27T09:24:42.786004+0000","last_became_peered":"2021-01-27T09:24:42.786004+0000","last_unstale":"2021-01-27T09:24:58.213812+0000","last_undegraded":"2021-01-27T09:24:58.213812+0000","last_fullsized":"2021-01-27T09:24:58.213812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208043+0000","last_change":"2021-01-27T09:24:40.315900+0000","last_active":"2021-01-27T09:24:58.208043+0000","last_peered":"2021-01-27T09:24:58.208043+0000","last_clean":"2021-01-27T09:24:58.208043+0000","last_became_active":"2021-01-27T09:24:40.315522+0000","last_became_peered":"2021-01-27T09:24:40.315522+0000","last_unstale":"2021-01-27T09:24:58.208043+0000","last_undegraded":"2021-01-27T09:24:58.208043+0000","last_fullsized":"2021-01-27T09:24:58.208043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"45'2","reported_seq":"32","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206934+0000","last_change":"2021-01-27T09:24:22.444137+0000","last_active":"2021-01-27T09:24:58.206934+0000","last_peered":"2021-01-27T09:24:58.206934+0000","last_clean":"2021-01-27T09:24:58.206934+0000","last_became_active":"2021-01-27T09:24:22.336576+0000","last_became_peered":"2021-01-27T09:24:22.336576+0000","last_unstale":"2021-01-27T09:24:58.206934+0000","last_undegraded":"2021-01-27T09:24:58.206934+0000","last_fullsized":"2021-01-27T09:24:58.206934+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"58'21","reported_seq":"53","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220210+0000","last_change":"2021-01-27T09:24:38.299043+0000","last_active":"2021-01-27T09:24:58.220210+0000","last_peered":"2021-01-27T09:24:58.220210+0000","last_clean":"2021-01-27T09:24:58.220210+0000","last_became_active":"2021-01-27T09:24:38.298659+0000","last_became_peered":"2021-01-27T09:24:38.298659+0000","last_unstale":"2021-01-27T09:24:58.220210+0000","last_undegraded":"2021-01-27T09:24:58.220210+0000","last_fullsized":"2021-01-27T09:24:58.220210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205681+0000","last_change":"2021-01-27T09:24:42.788205+0000","last_active":"2021-01-27T09:24:58.205681+0000","last_peered":"2021-01-27T09:24:58.205681+0000","last_clean":"2021-01-27T09:24:58.205681+0000","last_became_active":"2021-01-27T09:24:42.787837+0000","last_became_peered":"2021-01-27T09:24:42.787837+0000","last_unstale":"2021-01-27T09:24:58.205681+0000","last_undegraded":"2021-01-27T09:24:58.205681+0000","last_fullsized":"2021-01-27T09:24:58.205681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212607+0000","last_change":"2021-01-27T09:24:40.323945+0000","last_active":"2021-01-27T09:24:58.212607+0000","last_peered":"2021-01-27T09:24:58.212607+0000","last_clean":"2021-01-27T09:24:58.212607+0000","last_became_active":"2021-01-27T09:24:40.323506+0000","last_became_peered":"2021-01-27T09:24:40.323506+0000","last_unstale":"2021-01-27T09:24:58.212607+0000","last_undegraded":"2021-01-27T09:24:58.212607+0000","last_fullsized":"2021-01-27T09:24:58.212607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214477+0000","last_change":"2021-01-27T09:24:18.301581+0000","last_active":"2021-01-27T09:24:58.214477+0000","last_peered":"2021-01-27T09:24:58.214477+0000","last_clean":"2021-01-27T09:24:58.214477+0000","last_became_active":"2021-01-27T09:24:18.301206+0000","last_became_peered":"2021-01-27T09:24:18.301206+0000","last_unstale":"2021-01-27T09:24:58.214477+0000","last_undegraded":"2021-01-27T09:24:58.214477+0000","last_fullsized":"2021-01-27T09:24:58.214477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"58'23","reported_seq":"56","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267855+0000","last_change":"2021-01-27T09:24:38.632049+0000","last_active":"2021-01-27T09:24:58.267855+0000","last_peered":"2021-01-27T09:24:58.267855+0000","last_clean":"2021-01-27T09:24:58.267855+0000","last_became_active":"2021-01-27T09:24:38.631323+0000","last_became_peered":"2021-01-27T09:24:38.631323+0000","last_unstale":"2021-01-27T09:24:58.267855+0000","last_undegraded":"2021-01-27T09:24:58.267855+0000","last_fullsized":"2021-01-27T09:24:58.267855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217601+0000","last_change":"2021-01-27T09:24:42.795025+0000","last_active":"2021-01-27T09:24:58.217601+0000","last_peered":"2021-01-27T09:24:58.217601+0000","last_clean":"2021-01-27T09:24:58.217601+0000","last_became_active":"2021-01-27T09:24:42.794604+0000","last_became_peered":"2021-01-27T09:24:42.794604+0000","last_unstale":"2021-01-27T09:24:58.217601+0000","last_undegraded":"2021-01-27T09:24:58.217601+0000","last_fullsized":"2021-01-27T09:24:58.217601+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.216630+0000","last_change":"2021-01-27T09:24:40.317107+0000","last_active":"2021-01-27T09:24:58.216630+0000","last_peered":"2021-01-27T09:24:58.216630+0000","last_clean":"2021-01-27T09:24:58.216630+0000","last_became_active":"2021-01-27T09:24:40.316747+0000","last_became_peered":"2021-01-27T09:24:40.316747+0000","last_unstale":"2021-01-27T09:24:58.216630+0000","last_undegraded":"2021-01-27T09:24:58.216630+0000","last_fullsized":"2021-01-27T09:24:58.216630+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207657+0000","last_change":"2021-01-27T09:24:18.301682+0000","last_active":"2021-01-27T09:24:58.207657+0000","last_peered":"2021-01-27T09:24:58.207657+0000","last_clean":"2021-01-27T09:24:58.207657+0000","last_became_active":"2021-01-27T09:24:18.301067+0000","last_became_peered":"2021-01-27T09:24:18.301067+0000","last_unstale":"2021-01-27T09:24:58.207657+0000","last_undegraded":"2021-01-27T09:24:58.207657+0000","last_fullsized":"2021-01-27T09:24:58.207657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'14","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217242+0000","last_change":"2021-01-27T09:24:38.289702+0000","last_active":"2021-01-27T09:24:58.217242+0000","last_peered":"2021-01-27T09:24:58.217242+0000","last_clean":"2021-01-27T09:24:58.217242+0000","last_became_active":"2021-01-27T09:24:38.289272+0000","last_became_peered":"2021-01-27T09:24:38.289272+0000","last_unstale":"2021-01-27T09:24:58.217242+0000","last_undegraded":"2021-01-27T09:24:58.217242+0000","last_fullsized":"2021-01-27T09:24:58.217242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207141+0000","last_change":"2021-01-27T09:24:42.782924+0000","last_active":"2021-01-27T09:24:58.207141+0000","last_peered":"2021-01-27T09:24:58.207141+0000","last_clean":"2021-01-27T09:24:58.207141+0000","last_became_active":"2021-01-27T09:24:42.782155+0000","last_became_peered":"2021-01-27T09:24:42.782155+0000","last_unstale":"2021-01-27T09:24:58.207141+0000","last_undegraded":"2021-01-27T09:24:58.207141+0000","last_fullsized":"2021-01-27T09:24:58.207141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.246250+0000","last_change":"2021-01-27T09:24:59.246250+0000","last_active":"2021-01-27T09:24:59.246250+0000","last_peered":"2021-01-27T09:24:59.246250+0000","last_clean":"2021-01-27T09:24:59.246250+0000","last_became_active":"2021-01-27T09:24:59.245765+0000","last_became_peered":"2021-01-27T09:24:59.245765+0000","last_unstale":"2021-01-27T09:24:59.246250+0000","last_undegraded":"2021-01-27T09:24:59.246250+0000","last_fullsized":"2021-01-27T09:24:59.246250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"58'18","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206493+0000","last_change":"2021-01-27T09:24:38.633808+0000","last_active":"2021-01-27T09:24:58.206493+0000","last_peered":"2021-01-27T09:24:58.206493+0000","last_clean":"2021-01-27T09:24:58.206493+0000","last_became_active":"2021-01-27T09:24:38.633430+0000","last_became_peered":"2021-01-27T09:24:38.633430+0000","last_unstale":"2021-01-27T09:24:58.206493+0000","last_undegraded":"2021-01-27T09:24:58.206493+0000","last_fullsized":"2021-01-27T09:24:58.206493+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323465+0000","last_change":"2021-01-27T09:24:40.321484+0000","last_active":"2021-01-27T09:27:11.323465+0000","last_peered":"2021-01-27T09:27:11.323465+0000","last_clean":"2021-01-27T09:27:11.323465+0000","last_became_active":"2021-01-27T09:24:40.321050+0000","last_became_peered":"2021-01-27T09:24:40.321050+0000","last_unstale":"2021-01-27T09:27:11.323465+0000","last_undegraded":"2021-01-27T09:27:11.323465+0000","last_fullsized":"2021-01-27T09:27:11.323465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1364,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":524,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6104,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739048,"statfs":{"total":95995035648,"available":95988785152,"internally_reserved":0,"allocated":802816,"data_stored":237490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":1.9319999999999999,"15min":1.9419999999999999},"min":{"1min":1.425,"5min":1.397,"15min":1.397},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.9570000000000001,"15min":1.9510000000000001},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":2.819}]},{"osd":1,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.3450000000000002,"5min":2.097,"15min":2.0550000000000002},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":2.1230000000000002},{"interface":"front","average":{"1min":2.4940000000000002,"5min":2.286,"15min":2.2509999999999999},"min":{"1min":1.6930000000000001,"5min":1.264,"15min":1.264},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.403}]},{"osd":2,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":2.0179999999999998,"15min":2.0059999999999998},"min":{"1min":1.3340000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.71},{"interface":"front","average":{"1min":2.7599999999999998,"5min":2.5569999999999999,"15min":2.5230000000000001},"min":{"1min":1.7949999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.0289999999999999,"5min":4.0289999999999999,"15min":4.0289999999999999},"last":2.5059999999999998}]},{"osd":3,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":2.4100000000000001,"15min":2.4039999999999999},"min":{"1min":1.486,"5min":1.4810000000000001,"15min":1.4810000000000001},"max":{"1min":3.6840000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":2.4049999999999998},{"interface":"front","average":{"1min":2.9940000000000002,"5min":2.8700000000000001,"15min":2.8500000000000001},"min":{"1min":2.2360000000000002,"5min":1.877,"15min":1.877},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":2.698}]},{"osd":4,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.121,"5min":2.7410000000000001,"15min":2.677},"min":{"1min":0.93600000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":5.9299999999999997,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":3.0680000000000001},{"interface":"front","average":{"1min":3.0720000000000001,"5min":2.778,"15min":2.7290000000000001},"min":{"1min":2.145,"5min":1.5940000000000001,"15min":1.5940000000000001},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":2.8759999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.3650000000000002,"5min":3.1539999999999999,"15min":3.1190000000000002},"min":{"1min":1.407,"5min":1.179,"15min":1.179},"max":{"1min":5.7530000000000001,"5min":5.7530000000000001,"15min":5.7530000000000001},"last":3.0139999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.0939999999999999,"15min":3.0489999999999999},"min":{"1min":1.234,"5min":1.139,"15min":1.139},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":3.294}]},{"osd":6,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.5209999999999999,"5min":3.3170000000000002,"15min":3.2829999999999999},"min":{"1min":1.8839999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":3.5110000000000001},{"interface":"front","average":{"1min":3.5070000000000001,"5min":3.1349999999999998,"15min":3.073},"min":{"1min":1.9330000000000001,"5min":1.24,"15min":1.24},"max":{"1min":8.1470000000000002,"5min":8.1470000000000002,"15min":8.1470000000000002},"last":3.3730000000000002}]}]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":240233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.734,"15min":1.718},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3490000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.633},{"interface":"front","average":{"1min":1.9990000000000001,"5min":1.9930000000000001,"15min":1.98},"min":{"1min":1.395,"5min":1.206,"15min":1.206},"max":{"1min":3.2280000000000002,"5min":3.375,"15min":3.375},"last":2.367}]},{"osd":1,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":2.3799999999999999,"15min":2.4089999999999998},"min":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":3.1120000000000001},{"interface":"front","average":{"1min":2.3620000000000001,"5min":2.343,"15min":2.351},"min":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":3.2440000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.5600000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.5739999999999998,"5min":2.6269999999999998,"15min":2.6850000000000001},"min":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"max":{"1min":3.4340000000000002,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.905,"5min":2.0219999999999998,"15min":2.0569999999999999},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.657,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.9510000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.778,"15min":2.8340000000000001},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.3150000000000004,"5min":4.3419999999999996,"15min":4.3419999999999996},"last":3.4790000000000001},{"interface":"front","average":{"1min":3.0649999999999999,"5min":3.0800000000000001,"15min":3.1200000000000001},"min":{"1min":1.752,"5min":1.7110000000000001,"15min":1.7110000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":2.6360000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":2.4039999999999999,"15min":2.4279999999999999},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.9249999999999998,"5min":3.161,"15min":3.161},"last":2.2629999999999999},{"interface":"front","average":{"1min":3.3559999999999999,"5min":3.2109999999999999,"15min":3.238},"min":{"1min":1.9139999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"max":{"1min":4.0830000000000002,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":2.9329999999999998}]},{"osd":5,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":2.6469999999999998,"15min":2.657},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":3.2109999999999999,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":2.5630000000000002},{"interface":"front","average":{"1min":3.1920000000000002,"5min":3.1779999999999999,"15min":3.2269999999999999},"min":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"max":{"1min":4.7800000000000002,"5min":4.782,"15min":4.782},"last":3.8769999999999998}]},{"osd":7,"last update":"Wed Jan 27 09:26:22 2021","interfaces":[{"interface":"back","average":{"1min":3.5569999999999999,"5min":3.605,"15min":3.613},"min":{"1min":2.254,"5min":2.254,"15min":2.254},"max":{"1min":4.8179999999999996,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":3.2599999999999998},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.4620000000000002,"15min":3.4849999999999999},"min":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"max":{"1min":4.4790000000000001,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":4.2430000000000003}]}]},{"osd":1,"up_from":16,"seq":68719476809,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6696,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738456,"statfs":{"total":95995035648,"available":95988178944,"internally_reserved":0,"allocated":950272,"data_stored":243077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.8560000000000001,"5min":1.595,"15min":1.3089999999999999},"min":{"1min":1.1779999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.6539999999999999,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.1389999999999998},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.738,"15min":1.405},"min":{"1min":0.96399999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.5700000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:27:11 2021","interfaces":[{"interface":"back","average":{"1min":2.1299999999999999,"5min":1.95,"15min":1.744},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":2.5329999999999999},{"interface":"front","average":{"1min":2.1419999999999999,"5min":2.0649999999999999,"15min":1.786},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":3.6520000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.9039999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":2.198,"15min":2.101},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":2.927},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.9359999999999999,"15min":1.9079999999999999},"min":{"1min":1.179,"5min":1.179,"15min":1.179},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":2.0699999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.8130000000000002,"5min":2.5270000000000001,"15min":2.3780000000000001},"min":{"1min":1.5660000000000001,"5min":1.327,"15min":1.327},"max":{"1min":3.601,"5min":3.863,"15min":3.863},"last":2.8410000000000002},{"interface":"front","average":{"1min":3.0129999999999999,"5min":2.7639999999999998,"15min":2.5779999999999998},"min":{"1min":1.462,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":4.1100000000000003,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":2.2250000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:26:25 2021","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":2.891,"15min":2.8290000000000002},"min":{"1min":2.1619999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":3.8250000000000002},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.0840000000000001,"15min":3.0409999999999999},"min":{"1min":1.8640000000000001,"5min":1.181,"15min":1.181},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":2.4729999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.6970000000000001,"5min":2.5840000000000001,"15min":2.5779999999999998},"min":{"1min":1.784,"5min":1.494,"15min":1.494},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":2.9950000000000001},{"interface":"front","average":{"1min":3.3119999999999998,"5min":3.1589999999999998,"15min":3.1499999999999999},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":4.2110000000000003}]},{"osd":7,"last update":"Wed Jan 27 09:26:23 2021","interfaces":[{"interface":"back","average":{"1min":3.3650000000000002,"5min":3.3690000000000002,"15min":3.3690000000000002},"min":{"1min":2.4940000000000002,"5min":1.849,"15min":1.849},"max":{"1min":4.7430000000000003,"5min":4.7430000000000003,"15min":4.7430000000000003},"last":4.5519999999999996},{"interface":"front","average":{"1min":3.4239999999999999,"5min":3.3199999999999998,"15min":3.302},"min":{"1min":1.776,"5min":1.5569999999999999,"15min":1.5569999999999999},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":2.7069999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673037,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6412,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738740,"statfs":{"total":95995035648,"available":95988469760,"internally_reserved":0,"allocated":790528,"data_stored":238133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:26:43 2021","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.704,"15min":1.4359999999999999},"min":{"1min":1.226,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.7370000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":1.387},{"interface":"front","average":{"1min":2.2570000000000001,"5min":2.0550000000000002,"15min":1.7609999999999999},"min":{"1min":1.2509999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":1.9750000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:26:13 2021","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":1.7869999999999999,"15min":1.597},"min":{"1min":1.351,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.7930000000000001,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":1.6579999999999999},{"interface":"front","average":{"1min":2.306,"5min":2.0449999999999999,"15min":1.7549999999999999},"min":{"1min":1.5329999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.4249999999999998,"5min":4.048,"15min":4.048},"last":1.5569999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":1.8939999999999999,"15min":1.8200000000000001},"min":{"1min":1.4970000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":2.5110000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.72},{"interface":"front","average":{"1min":2.8969999999999998,"5min":2.5409999999999999,"15min":2.323},"min":{"1min":1.667,"5min":1.4990000000000001,"15min":1.4990000000000001},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":2.2330000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":3.0720000000000001,"5min":2.794,"15min":2.6459999999999999},"min":{"1min":2.1749999999999998,"5min":1.6479999999999999,"15min":1.6479999999999999},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":2.6520000000000001},{"interface":"front","average":{"1min":2.512,"5min":2.516,"15min":2.508},"min":{"1min":1.8280000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"max":{"1min":3.7759999999999998,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":2.9540000000000002}]},{"osd":5,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":2.7229999999999999,"15min":2.653},"min":{"1min":2.1789999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":3.589},{"interface":"front","average":{"1min":3.492,"5min":3.2589999999999999,"15min":3.1819999999999999},"min":{"1min":2.532,"5min":2.3540000000000001,"15min":2.3540000000000001},"max":{"1min":5.0090000000000003,"5min":5.0090000000000003,"15min":5.0090000000000003},"last":2.9039999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:26:59 2021","interfaces":[{"interface":"back","average":{"1min":2.8300000000000001,"5min":2.9540000000000002,"15min":2.9860000000000002},"min":{"1min":2.069,"5min":2.0350000000000001,"15min":2.0350000000000001},"max":{"1min":3.6080000000000001,"5min":4.54,"15min":4.54},"last":3.3380000000000001},{"interface":"front","average":{"1min":3.4609999999999999,"5min":3.468,"15min":3.456},"min":{"1min":2.331,"5min":2.331,"15min":2.331},"max":{"1min":4.6500000000000004,"5min":4.6500000000000004,"15min":4.6500000000000004},"last":3.1400000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:26:23 2021","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":3.1440000000000001,"15min":3.1589999999999998},"min":{"1min":2.1840000000000002,"5min":2.137,"15min":2.137},"max":{"1min":4,"5min":4.2590000000000003,"15min":4.2590000000000003},"last":3.3919999999999999},{"interface":"front","average":{"1min":3.6989999999999998,"5min":3.593,"15min":3.5750000000000002},"min":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"max":{"1min":4.3970000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":3.2879999999999998}]}]},{"osd":2,"up_from":21,"seq":90194313283,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":724992,"data_stored":234913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:27:15 2021","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.7829999999999999,"15min":1.641},"min":{"1min":1.0189999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.0089999999999999,"5min":7.2839999999999998,"15min":7.2839999999999998},"last":2.052},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.774,"15min":1.506},"min":{"1min":0.93999999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.2090000000000001,"5min":3.302,"15min":3.302},"last":1.8220000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:27:15 2021","interfaces":[{"interface":"back","average":{"1min":2.0550000000000002,"5min":2.0680000000000001,"15min":1.821},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":3.4239999999999999,"5min":4.726,"15min":4.726},"last":1.6499999999999999},{"interface":"front","average":{"1min":2.1269999999999998,"5min":1.988,"15min":1.804},"min":{"1min":1.377,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.9769999999999999,"5min":3.613,"15min":3.613},"last":2.1400000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.8620000000000001,"15min":1.823},"min":{"1min":1.218,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.2130000000000001,"5min":3.8769999999999998,"15min":3.8769999999999998},"last":2.1850000000000001},{"interface":"front","average":{"1min":2.3090000000000002,"5min":2.5310000000000001,"15min":2.3809999999999998},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.1429999999999998,"5min":7.827,"15min":7.827},"last":2.6240000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":2.8650000000000002,"15min":2.8330000000000002},"min":{"1min":1.444,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":4.1189999999999998,"5min":8.2420000000000009,"15min":8.2420000000000009},"last":2.9630000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.6549999999999998,"15min":2.6030000000000002},"min":{"1min":1.75,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":2.339}]},{"osd":5,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":3.2240000000000002,"5min":3.1600000000000001,"15min":3.121},"min":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"max":{"1min":8.6310000000000002,"5min":8.6310000000000002,"15min":8.6310000000000002},"last":3.423},{"interface":"front","average":{"1min":2.8740000000000001,"5min":2.9350000000000001,"15min":2.9430000000000001},"min":{"1min":1.7649999999999999,"5min":1.331,"15min":1.331},"max":{"1min":3.7269999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":2.5110000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":2.5910000000000002,"15min":2.649},"min":{"1min":1.7090000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"max":{"1min":3.5089999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":2.6920000000000002},{"interface":"front","average":{"1min":3.2919999999999998,"5min":3.3889999999999998,"15min":3.383},"min":{"1min":1.845,"5min":1.796,"15min":1.796},"max":{"1min":4.5090000000000003,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":3.2429999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:26:29 2021","interfaces":[{"interface":"back","average":{"1min":3.1429999999999998,"5min":3.1509999999999998,"15min":3.1520000000000001},"min":{"1min":2.1859999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.8580000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":3.1789999999999998},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.923,"15min":2.948},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":3.3460000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":3.0390000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6536,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738616,"statfs":{"total":95995035648,"available":95988342784,"internally_reserved":0,"allocated":917504,"data_stored":242742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.5780000000000001,"15min":1.452},"min":{"1min":0.879,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3679999999999999,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.016},{"interface":"front","average":{"1min":1.738,"5min":1.7390000000000001,"15min":1.677},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.5619999999999998,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":1.8819999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":1.929,"15min":1.7949999999999999},"min":{"1min":1.2789999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.8980000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":2.7360000000000002},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.827,"15min":1.835},"min":{"1min":0.97999999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":2.427}]},{"osd":2,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":2.0179999999999998,"15min":2.0390000000000001},"min":{"1min":1.1830000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.9410000000000001},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.2130000000000001,"15min":2.129},"min":{"1min":1.252,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1600000000000001,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":2.5139999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:27:00 2021","interfaces":[{"interface":"back","average":{"1min":2.6869999999999998,"5min":2.4790000000000001,"15min":2.3610000000000002},"min":{"1min":1.8440000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":2.7909999999999999},{"interface":"front","average":{"1min":2.738,"5min":2.657,"15min":2.5299999999999998},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":3}]},{"osd":5,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":2.8799999999999999,"15min":2.8490000000000002},"min":{"1min":1.9810000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"max":{"1min":3.9140000000000001,"5min":4.8410000000000002,"15min":4.8410000000000002},"last":3.3879999999999999},{"interface":"front","average":{"1min":2.6619999999999999,"5min":2.6970000000000001,"15min":2.6749999999999998},"min":{"1min":1.946,"5min":1.5580000000000001,"15min":1.5580000000000001},"max":{"1min":3.4239999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":3.4590000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:56 2021","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":2.8780000000000001,"15min":2.8650000000000002},"min":{"1min":2.0649999999999999,"5min":1.784,"15min":1.784},"max":{"1min":3.6970000000000001,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":3.1339999999999999},{"interface":"front","average":{"1min":3.0539999999999998,"5min":3.1520000000000001,"15min":3.1240000000000001},"min":{"1min":2.0670000000000002,"5min":1.5069999999999999,"15min":1.5069999999999999},"max":{"1min":3.9500000000000002,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":3.6680000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:26:24 2021","interfaces":[{"interface":"back","average":{"1min":3.073,"5min":3.177,"15min":3.1949999999999998},"min":{"1min":1.885,"5min":1.885,"15min":1.885},"max":{"1min":3.964,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":3.343},{"interface":"front","average":{"1min":3.3290000000000002,"5min":3.4609999999999999,"15min":3.4830000000000001},"min":{"1min":2.202,"5min":1.9330000000000001,"15min":1.9330000000000001},"max":{"1min":4.3550000000000004,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.8570000000000002}]}]},{"osd":4,"up_from":31,"seq":133143986231,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6420,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738732,"statfs":{"total":95995035648,"available":95988461568,"internally_reserved":0,"allocated":864256,"data_stored":240429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":1.8580000000000001,"15min":1.669},"min":{"1min":1.619,"5min":1.204,"15min":1.204},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":1.462},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.7190000000000001,"15min":1.631},"min":{"1min":1.381,"5min":1.095,"15min":1.095},"max":{"1min":2.4809999999999999,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.365}]},{"osd":1,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.8180000000000001,"15min":1.71},"min":{"1min":1.5489999999999999,"5min":1.143,"15min":1.143},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":2.7069999999999999,"5min":2.339,"15min":2.0590000000000002},"min":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"max":{"1min":4.1589999999999998,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":1.9890000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.8199999999999998,"5min":2.5459999999999998,"15min":2.3479999999999999},"min":{"1min":1.526,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":3.875,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":2.2919999999999998},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.2530000000000001,"15min":2.129},"min":{"1min":1.8120000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":2.0880000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.8029999999999999,"5min":2.4940000000000002,"15min":2.3220000000000001},"min":{"1min":1.883,"5min":1.363,"15min":1.363},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8240000000000001},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.6160000000000001,"15min":2.448},"min":{"1min":2.302,"5min":1.8320000000000001,"15min":1.8320000000000001},"max":{"1min":4.3579999999999997,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.1200000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.8700000000000001,"15min":2.738},"min":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"max":{"1min":4.0369999999999999,"5min":4.569,"15min":4.569},"last":1.1399999999999999},{"interface":"front","average":{"1min":3.2229999999999999,"5min":3.1640000000000001,"15min":3.0510000000000002},"min":{"1min":1.51,"5min":1.51,"15min":1.51},"max":{"1min":4.2380000000000004,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.7150000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:59 2021","interfaces":[{"interface":"back","average":{"1min":3.0369999999999999,"5min":2.952,"15min":2.9580000000000002},"min":{"1min":2.1120000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":2.25},{"interface":"front","average":{"1min":3.121,"5min":3.0310000000000001,"15min":3.0030000000000001},"min":{"1min":2.1200000000000001,"5min":1.754,"15min":1.754},"max":{"1min":3.7949999999999999,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":1.9390000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":3.081,"5min":3.2480000000000002,"15min":3.2759999999999998},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":4.3280000000000003,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":1.7889999999999999},{"interface":"front","average":{"1min":3.5150000000000001,"5min":3.7490000000000001,"15min":3.7879999999999998},"min":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"max":{"1min":4.5030000000000001,"5min":4.806,"15min":4.806},"last":2.1629999999999998}]}]},{"osd":5,"up_from":36,"seq":154618822706,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6200,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738952,"statfs":{"total":95995035648,"available":95988686848,"internally_reserved":0,"allocated":770048,"data_stored":235997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":1.8959999999999999,"15min":1.804},"min":{"1min":1.3460000000000001,"5min":1.143,"15min":1.143},"max":{"1min":2.9399999999999999,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":2.4620000000000002},{"interface":"front","average":{"1min":1.9910000000000001,"5min":1.794,"15min":1.6679999999999999},"min":{"1min":1.3240000000000001,"5min":1.056,"15min":1.056},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":1.9239999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.121,"15min":2.0190000000000001},"min":{"1min":1.474,"5min":1.246,"15min":1.246},"max":{"1min":3.4569999999999999,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":1.8520000000000001},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.2810000000000001,"15min":2.2269999999999999},"min":{"1min":1.8480000000000001,"5min":1.399,"15min":1.399},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":2.2970000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":2.0920000000000001,"15min":2.0409999999999999},"min":{"1min":1.526,"5min":1.365,"15min":1.365},"max":{"1min":3.9940000000000002,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":2},{"interface":"front","average":{"1min":2.7930000000000001,"5min":2.5329999999999999,"15min":2.3940000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":3.6120000000000001,"5min":4.3440000000000003,"15min":4.3440000000000003},"last":2.7679999999999998}]},{"osd":3,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.6629999999999998,"5min":2.4860000000000002,"15min":2.379},"min":{"1min":1.581,"5min":1.581,"15min":1.581},"max":{"1min":4.4020000000000001,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":2.6890000000000001},{"interface":"front","average":{"1min":3.141,"5min":2.8540000000000001,"15min":2.722},"min":{"1min":2.3450000000000002,"5min":1.6639999999999999,"15min":1.6639999999999999},"max":{"1min":3.9020000000000001,"5min":4.5110000000000001,"15min":4.5110000000000001},"last":3.1499999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":3,"5min":2.589,"15min":2.4910000000000001},"min":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":2.9369999999999998},{"interface":"front","average":{"1min":3.149,"5min":2.7309999999999999,"15min":2.5289999999999999},"min":{"1min":1.984,"5min":1.395,"15min":1.395},"max":{"1min":5.8769999999999998,"5min":5.8769999999999998,"15min":5.8769999999999998},"last":3.0609999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":3.0569999999999999,"15min":3.0110000000000001},"min":{"1min":2.2909999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"max":{"1min":5.3099999999999996,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":3.5600000000000001},{"interface":"front","average":{"1min":3.573,"5min":3.2290000000000001,"15min":3.1659999999999999},"min":{"1min":2.6349999999999998,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":3.4729999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":3.5920000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.4220000000000002,"5min":1.3,"15min":1.3},"max":{"1min":6.1479999999999997,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":3.8300000000000001},{"interface":"front","average":{"1min":3.4510000000000001,"5min":3.4380000000000002,"15min":3.4359999999999999},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.3280000000000003,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":3.4350000000000001}]}]}]}} 2021-01-27T09:27:22.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T09:27:22.577 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:22.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:22 smithi103 bash[9772]: audit 2021-01-27T09:27:21.642897+0000 mgr.y (mgr.14138) 431 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:22 smithi103 bash[13570]: audit 2021-01-27T09:27:21.642897+0000 mgr.y (mgr.14138) 431 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:22.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:22 smithi047 bash[9721]: audit 2021-01-27T09:27:21.642897+0000 mgr.y (mgr.14138) 431 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:23.749 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:23 smithi103 bash[9772]: cluster 2021-01-27T09:27:22.295298+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:23.750 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:23 smithi103 bash[13570]: cluster 2021-01-27T09:27:22.295298+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:23.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:23 smithi047 bash[9721]: cluster 2021-01-27T09:27:22.295298+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:24.147 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:24 smithi103 bash[10018]: debug 2021-01-27T09:27:24.013+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:24.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:24.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:24 smithi047 bash[9721]: audit 2021-01-27T09:27:24.016063+0000 mgr.y (mgr.14138) 433 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:24.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:24 smithi103 bash[9772]: audit 2021-01-27T09:27:24.016063+0000 mgr.y (mgr.14138) 433 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:24.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:24 smithi103 bash[13570]: audit 2021-01-27T09:27:24.016063+0000 mgr.y (mgr.14138) 433 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:25.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 -- 172.21.15.103:0/3378917620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 msgr2=0x7f41480fdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:25.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3378917620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480fdab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4140009dc0 tx=0x7f4140004d10).stop 2021-01-27T09:27:25.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 -- 172.21.15.103:0/3378917620 shutdown_connections 2021-01-27T09:27:25.540 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3378917620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480fdab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3378917620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 0x7f41480f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3378917620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 -- 172.21.15.103:0/3378917620 >> 172.21.15.103:0/3378917620 conn(0x7f41480f0110 msgr2=0x7f41480f2550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 -- 172.21.15.103:0/3378917620 shutdown_connections 2021-01-27T09:27:25.541 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.533+0000 7f414f0ca700 1 -- 172.21.15.103:0/3378917620 wait complete. 2021-01-27T09:27:25.543 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 Processor -- start 2021-01-27T09:27:25.543 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- start start 2021-01-27T09:27:25.543 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 0x7f41480f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:25.544 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:25.544 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:25.544 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480f5080 con 0x7f414805f670 2021-01-27T09:27:25.544 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480f51f0 con 0x7f41480fb620 2021-01-27T09:27:25.544 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480f53b0 con 0x7f41480f8bf0 2021-01-27T09:27:25.545 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f4147fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:25.545 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f4147fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33190/0 (socket says 172.21.15.103:33190) 2021-01-27T09:27:25.545 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f4147fff700 1 -- 172.21.15.103:0/3428446944 learned_addr learned my addr 172.21.15.103:0/3428446944 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:25.545 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:25.545 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414ce66700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 0x7f41480f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:25.546 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 -- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 msgr2=0x7f41480f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:25.546 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.546 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 -- 172.21.15.103:0/3428446944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 msgr2=0x7f41480f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:25.546 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 0x7f41480f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.547 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 -- 172.21.15.103:0/3428446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414810f780 con 0x7f41480fb620 2021-01-27T09:27:25.547 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f4147fff700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:27:25.547 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414d667700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480f4a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f4140009dc0 tx=0x7f4140004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:25.547 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e070 con 0x7f41480fb620 2021-01-27T09:27:25.547 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4140004520 con 0x7f41480fb620 2021-01-27T09:27:25.548 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414810f9d0 con 0x7f41480fb620 2021-01-27T09:27:25.548 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140018070 con 0x7f41480fb620 2021-01-27T09:27:25.548 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414810fe00 con 0x7f41480fb620 2021-01-27T09:27:25.549 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.537+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148045420 con 0x7f41480fb620 2021-01-27T09:27:25.549 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.541+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f4140024030 con 0x7f41480fb620 2021-01-27T09:27:25.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.541+0000 7f41457fa700 1 --2- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 0x7f413005e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:25.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.541+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f4140077710 con 0x7f41480fb620 2021-01-27T09:27:25.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.541+0000 7f414ce66700 1 --2- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 0x7f413005e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:25.550 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.541+0000 7f414ce66700 1 --2- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 0x7f413005e1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f413c0096c0 tx=0x7f413c009be0).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:25.551 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.545+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f414004a470 con 0x7f41480fb620 2021-01-27T09:27:25.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:25 smithi103 bash[13570]: cluster 2021-01-27T09:27:24.296552+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:25.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:25 smithi103 bash[9772]: cluster 2021-01-27T09:27:24.296552+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:25.712 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.705+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 --> v2:172.21.15.103:6800/3303543367 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4148100750 con 0x7f413005bd20 2021-01-27T09:27:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.725+0000 7f41457fa700 1 -- 172.21.15.103:0/3428446944 <== mgr.14138 v2:172.21.15.103:6800/3303543367 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345952 (secure 0 0 0) 0x7f4148100750 con 0x7f413005bd20 2021-01-27T09:27:25.733 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:27:25.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 msgr2=0x7f413005e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:25.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 0x7f413005e1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f413c0096c0 tx=0x7f413c009be0).stop 2021-01-27T09:27:25.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 msgr2=0x7f41480f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:25.741 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480f4a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f4140009dc0 tx=0x7f4140004d10).stop 2021-01-27T09:27:25.743 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 shutdown_connections 2021-01-27T09:27:25.743 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> v2:172.21.15.103:6800/3303543367 conn(0x7f413005bd20 0x7f413005e1e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41480fb620 0x7f41480f4a60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f414805f670 0x7f41480f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 --2- 172.21.15.103:0/3428446944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f41480f8bf0 0x7f41480f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 >> 172.21.15.103:0/3428446944 conn(0x7f41480f0110 msgr2=0x7f41480f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:25.744 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 shutdown_connections 2021-01-27T09:27:25.745 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:25.737+0000 7f414f0ca700 1 -- 172.21.15.103:0/3428446944 wait complete. 2021-01-27T09:27:25.745 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2021-01-27T09:27:25.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:25 smithi047 bash[9721]: cluster 2021-01-27T09:27:24.296552+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:26.409 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2021-01-27T09:27:24.295693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1247,"num_read_kb":747,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":50812,"kb_used_data":6524,"kb_used_omap":0,"kb_used_meta":44224,"kb_avail":749910404,"statfs":{"total":767960285184,"available":767908253696,"internally_reserved":0,"allocated":6680576,"data_stored":1913014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45285376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006324"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215105+0000","last_change":"2021-01-27T09:24:42.795232+0000","last_active":"2021-01-27T09:24:58.215105+0000","last_peered":"2021-01-27T09:24:58.215105+0000","last_clean":"2021-01-27T09:24:58.215105+0000","last_became_active":"2021-01-27T09:24:42.794802+0000","last_became_peered":"2021-01-27T09:24:42.794802+0000","last_unstale":"2021-01-27T09:24:58.215105+0000","last_undegraded":"2021-01-27T09:24:58.215105+0000","last_fullsized":"2021-01-27T09:24:58.215105+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218678+0000","last_change":"2021-01-27T09:24:40.311727+0000","last_active":"2021-01-27T09:24:58.218678+0000","last_peered":"2021-01-27T09:24:58.218678+0000","last_clean":"2021-01-27T09:24:58.218678+0000","last_became_active":"2021-01-27T09:24:40.311319+0000","last_became_peered":"2021-01-27T09:24:40.311319+0000","last_unstale":"2021-01-27T09:24:58.218678+0000","last_undegraded":"2021-01-27T09:24:58.218678+0000","last_fullsized":"2021-01-27T09:24:58.218678+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211532+0000","last_change":"2021-01-27T09:24:22.339750+0000","last_active":"2021-01-27T09:24:58.211532+0000","last_peered":"2021-01-27T09:24:58.211532+0000","last_clean":"2021-01-27T09:24:58.211532+0000","last_became_active":"2021-01-27T09:24:22.338494+0000","last_became_peered":"2021-01-27T09:24:22.338494+0000","last_unstale":"2021-01-27T09:24:58.211532+0000","last_undegraded":"2021-01-27T09:24:58.211532+0000","last_fullsized":"2021-01-27T09:24:58.211532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"58'20","reported_seq":"52","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214882+0000","last_change":"2021-01-27T09:24:38.305362+0000","last_active":"2021-01-27T09:24:58.214882+0000","last_peered":"2021-01-27T09:24:58.214882+0000","last_clean":"2021-01-27T09:24:58.214882+0000","last_became_active":"2021-01-27T09:24:38.304992+0000","last_became_peered":"2021-01-27T09:24:38.304992+0000","last_unstale":"2021-01-27T09:24:58.214882+0000","last_undegraded":"2021-01-27T09:24:58.214882+0000","last_fullsized":"2021-01-27T09:24:58.214882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219540+0000","last_change":"2021-01-27T09:24:42.785792+0000","last_active":"2021-01-27T09:24:58.219540+0000","last_peered":"2021-01-27T09:24:58.219540+0000","last_clean":"2021-01-27T09:24:58.219540+0000","last_became_active":"2021-01-27T09:24:42.785440+0000","last_became_peered":"2021-01-27T09:24:42.785440+0000","last_unstale":"2021-01-27T09:24:58.219540+0000","last_undegraded":"2021-01-27T09:24:58.219540+0000","last_fullsized":"2021-01-27T09:24:58.219540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205580+0000","last_change":"2021-01-27T09:24:40.311156+0000","last_active":"2021-01-27T09:24:58.205580+0000","last_peered":"2021-01-27T09:24:58.205580+0000","last_clean":"2021-01-27T09:24:58.205580+0000","last_became_active":"2021-01-27T09:24:40.310726+0000","last_became_peered":"2021-01-27T09:24:40.310726+0000","last_unstale":"2021-01-27T09:24:58.205580+0000","last_undegraded":"2021-01-27T09:24:58.205580+0000","last_fullsized":"2021-01-27T09:24:58.205580+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218199+0000","last_change":"2021-01-27T09:24:18.304726+0000","last_active":"2021-01-27T09:24:58.218199+0000","last_peered":"2021-01-27T09:24:58.218199+0000","last_clean":"2021-01-27T09:24:58.218199+0000","last_became_active":"2021-01-27T09:24:18.304311+0000","last_became_peered":"2021-01-27T09:24:18.304311+0000","last_unstale":"2021-01-27T09:24:58.218199+0000","last_undegraded":"2021-01-27T09:24:58.218199+0000","last_fullsized":"2021-01-27T09:24:58.218199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219018+0000","last_change":"2021-01-27T09:24:38.299940+0000","last_active":"2021-01-27T09:24:58.219018+0000","last_peered":"2021-01-27T09:24:58.219018+0000","last_clean":"2021-01-27T09:24:58.219018+0000","last_became_active":"2021-01-27T09:24:38.299407+0000","last_became_peered":"2021-01-27T09:24:38.299407+0000","last_unstale":"2021-01-27T09:24:58.219018+0000","last_undegraded":"2021-01-27T09:24:58.219018+0000","last_fullsized":"2021-01-27T09:24:58.219018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206827+0000","last_change":"2021-01-27T09:24:42.787399+0000","last_active":"2021-01-27T09:24:58.206827+0000","last_peered":"2021-01-27T09:24:58.206827+0000","last_clean":"2021-01-27T09:24:58.206827+0000","last_became_active":"2021-01-27T09:24:42.787011+0000","last_became_peered":"2021-01-27T09:24:42.787011+0000","last_unstale":"2021-01-27T09:24:58.206827+0000","last_undegraded":"2021-01-27T09:24:58.206827+0000","last_fullsized":"2021-01-27T09:24:58.206827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206697+0000","last_change":"2021-01-27T09:24:40.319483+0000","last_active":"2021-01-27T09:24:58.206697+0000","last_peered":"2021-01-27T09:24:58.206697+0000","last_clean":"2021-01-27T09:24:58.206697+0000","last_became_active":"2021-01-27T09:24:40.319020+0000","last_became_peered":"2021-01-27T09:24:40.319020+0000","last_unstale":"2021-01-27T09:24:58.206697+0000","last_undegraded":"2021-01-27T09:24:58.206697+0000","last_fullsized":"2021-01-27T09:24:58.206697+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"58'2","reported_seq":"57","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:15.066711+0000","last_change":"2021-01-27T09:24:22.543980+0000","last_active":"2021-01-27T09:27:15.066711+0000","last_peered":"2021-01-27T09:27:15.066711+0000","last_clean":"2021-01-27T09:27:15.066711+0000","last_became_active":"2021-01-27T09:24:22.336887+0000","last_became_peered":"2021-01-27T09:24:22.336887+0000","last_unstale":"2021-01-27T09:27:15.066711+0000","last_undegraded":"2021-01-27T09:27:15.066711+0000","last_fullsized":"2021-01-27T09:27:15.066711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"58'6","reported_seq":"29","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219601+0000","last_change":"2021-01-27T09:24:38.300524+0000","last_active":"2021-01-27T09:24:58.219601+0000","last_peered":"2021-01-27T09:24:58.219601+0000","last_clean":"2021-01-27T09:24:58.219601+0000","last_became_active":"2021-01-27T09:24:38.299955+0000","last_became_peered":"2021-01-27T09:24:38.299955+0000","last_unstale":"2021-01-27T09:24:58.219601+0000","last_undegraded":"2021-01-27T09:24:58.219601+0000","last_fullsized":"2021-01-27T09:24:58.219601+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211376+0000","last_change":"2021-01-27T09:24:42.789559+0000","last_active":"2021-01-27T09:24:58.211376+0000","last_peered":"2021-01-27T09:24:58.211376+0000","last_clean":"2021-01-27T09:24:58.211376+0000","last_became_active":"2021-01-27T09:24:42.788973+0000","last_became_peered":"2021-01-27T09:24:42.788973+0000","last_unstale":"2021-01-27T09:24:58.211376+0000","last_undegraded":"2021-01-27T09:24:58.211376+0000","last_fullsized":"2021-01-27T09:24:58.211376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209804+0000","last_change":"2021-01-27T09:24:40.320466+0000","last_active":"2021-01-27T09:24:58.209804+0000","last_peered":"2021-01-27T09:24:58.209804+0000","last_clean":"2021-01-27T09:24:58.209804+0000","last_became_active":"2021-01-27T09:24:40.319919+0000","last_became_peered":"2021-01-27T09:24:40.319919+0000","last_unstale":"2021-01-27T09:24:58.209804+0000","last_undegraded":"2021-01-27T09:24:58.209804+0000","last_fullsized":"2021-01-27T09:24:58.209804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207520+0000","last_change":"2021-01-27T09:24:22.341651+0000","last_active":"2021-01-27T09:24:58.207520+0000","last_peered":"2021-01-27T09:24:58.207520+0000","last_clean":"2021-01-27T09:24:58.207520+0000","last_became_active":"2021-01-27T09:24:22.337739+0000","last_became_peered":"2021-01-27T09:24:22.337739+0000","last_unstale":"2021-01-27T09:24:58.207520+0000","last_undegraded":"2021-01-27T09:24:58.207520+0000","last_fullsized":"2021-01-27T09:24:58.207520+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"58'13","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219412+0000","last_change":"2021-01-27T09:24:38.295864+0000","last_active":"2021-01-27T09:24:58.219412+0000","last_peered":"2021-01-27T09:24:58.219412+0000","last_clean":"2021-01-27T09:24:58.219412+0000","last_became_active":"2021-01-27T09:24:38.295497+0000","last_became_peered":"2021-01-27T09:24:38.295497+0000","last_unstale":"2021-01-27T09:24:58.219412+0000","last_undegraded":"2021-01-27T09:24:58.219412+0000","last_fullsized":"2021-01-27T09:24:58.219412+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218020+0000","last_change":"2021-01-27T09:24:42.794006+0000","last_active":"2021-01-27T09:24:58.218020+0000","last_peered":"2021-01-27T09:24:58.218020+0000","last_clean":"2021-01-27T09:24:58.218020+0000","last_became_active":"2021-01-27T09:24:42.793682+0000","last_became_peered":"2021-01-27T09:24:42.793682+0000","last_unstale":"2021-01-27T09:24:58.218020+0000","last_undegraded":"2021-01-27T09:24:58.218020+0000","last_fullsized":"2021-01-27T09:24:58.218020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220056+0000","last_change":"2021-01-27T09:24:40.317442+0000","last_active":"2021-01-27T09:24:58.220056+0000","last_peered":"2021-01-27T09:24:58.220056+0000","last_clean":"2021-01-27T09:24:58.220056+0000","last_became_active":"2021-01-27T09:24:40.316758+0000","last_became_peered":"2021-01-27T09:24:40.316758+0000","last_unstale":"2021-01-27T09:24:58.220056+0000","last_undegraded":"2021-01-27T09:24:58.220056+0000","last_fullsized":"2021-01-27T09:24:58.220056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"45'1","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215193+0000","last_change":"2021-01-27T09:24:22.350527+0000","last_active":"2021-01-27T09:24:58.215193+0000","last_peered":"2021-01-27T09:24:58.215193+0000","last_clean":"2021-01-27T09:24:58.215193+0000","last_became_active":"2021-01-27T09:24:22.343041+0000","last_became_peered":"2021-01-27T09:24:22.343041+0000","last_unstale":"2021-01-27T09:24:58.215193+0000","last_undegraded":"2021-01-27T09:24:58.215193+0000","last_fullsized":"2021-01-27T09:24:58.215193+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"58'16","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.216180+0000","last_change":"2021-01-27T09:24:38.303708+0000","last_active":"2021-01-27T09:24:58.216180+0000","last_peered":"2021-01-27T09:24:58.216180+0000","last_clean":"2021-01-27T09:24:58.216180+0000","last_became_active":"2021-01-27T09:24:38.303350+0000","last_became_peered":"2021-01-27T09:24:38.303350+0000","last_unstale":"2021-01-27T09:24:58.216180+0000","last_undegraded":"2021-01-27T09:24:58.216180+0000","last_fullsized":"2021-01-27T09:24:58.216180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220381+0000","last_change":"2021-01-27T09:24:42.776726+0000","last_active":"2021-01-27T09:24:58.220381+0000","last_peered":"2021-01-27T09:24:58.220381+0000","last_clean":"2021-01-27T09:24:58.220381+0000","last_became_active":"2021-01-27T09:24:42.776292+0000","last_became_peered":"2021-01-27T09:24:42.776292+0000","last_unstale":"2021-01-27T09:24:58.220381+0000","last_undegraded":"2021-01-27T09:24:58.220381+0000","last_fullsized":"2021-01-27T09:24:58.220381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208014+0000","last_change":"2021-01-27T09:24:40.312895+0000","last_active":"2021-01-27T09:24:58.208014+0000","last_peered":"2021-01-27T09:24:58.208014+0000","last_clean":"2021-01-27T09:24:58.208014+0000","last_became_active":"2021-01-27T09:24:40.312495+0000","last_became_peered":"2021-01-27T09:24:40.312495+0000","last_unstale":"2021-01-27T09:24:58.208014+0000","last_undegraded":"2021-01-27T09:24:58.208014+0000","last_fullsized":"2021-01-27T09:24:58.208014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267913+0000","last_change":"2021-01-27T09:24:22.343663+0000","last_active":"2021-01-27T09:24:58.267913+0000","last_peered":"2021-01-27T09:24:58.267913+0000","last_clean":"2021-01-27T09:24:58.267913+0000","last_became_active":"2021-01-27T09:24:22.343252+0000","last_became_peered":"2021-01-27T09:24:22.343252+0000","last_unstale":"2021-01-27T09:24:58.267913+0000","last_undegraded":"2021-01-27T09:24:58.267913+0000","last_fullsized":"2021-01-27T09:24:58.267913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"58'15","reported_seq":"67","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.584367+0000","last_change":"2021-01-27T09:24:59.584367+0000","last_active":"2021-01-27T09:24:59.584367+0000","last_peered":"2021-01-27T09:24:59.584367+0000","last_clean":"2021-01-27T09:24:59.584367+0000","last_became_active":"2021-01-27T09:24:59.246576+0000","last_became_peered":"2021-01-27T09:24:59.246576+0000","last_unstale":"2021-01-27T09:24:59.584367+0000","last_undegraded":"2021-01-27T09:24:59.584367+0000","last_fullsized":"2021-01-27T09:24:59.584367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206915+0000","last_change":"2021-01-27T09:24:42.777682+0000","last_active":"2021-01-27T09:24:58.206915+0000","last_peered":"2021-01-27T09:24:58.206915+0000","last_clean":"2021-01-27T09:24:58.206915+0000","last_became_active":"2021-01-27T09:24:42.777310+0000","last_became_peered":"2021-01-27T09:24:42.777310+0000","last_unstale":"2021-01-27T09:24:58.206915+0000","last_undegraded":"2021-01-27T09:24:58.206915+0000","last_fullsized":"2021-01-27T09:24:58.206915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212465+0000","last_change":"2021-01-27T09:24:40.319194+0000","last_active":"2021-01-27T09:24:58.212465+0000","last_peered":"2021-01-27T09:24:58.212465+0000","last_clean":"2021-01-27T09:24:58.212465+0000","last_became_active":"2021-01-27T09:24:40.318798+0000","last_became_peered":"2021-01-27T09:24:40.318798+0000","last_unstale":"2021-01-27T09:24:58.212465+0000","last_undegraded":"2021-01-27T09:24:58.212465+0000","last_fullsized":"2021-01-27T09:24:58.212465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"49'2","reported_seq":"29","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214544+0000","last_change":"2021-01-27T09:24:18.298129+0000","last_active":"2021-01-27T09:24:58.214544+0000","last_peered":"2021-01-27T09:24:58.214544+0000","last_clean":"2021-01-27T09:24:58.214544+0000","last_became_active":"2021-01-27T09:24:18.297527+0000","last_became_peered":"2021-01-27T09:24:18.297527+0000","last_unstale":"2021-01-27T09:24:58.214544+0000","last_undegraded":"2021-01-27T09:24:58.214544+0000","last_fullsized":"2021-01-27T09:24:58.214544+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"58'17","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269128+0000","last_change":"2021-01-27T09:24:38.292489+0000","last_active":"2021-01-27T09:24:58.269128+0000","last_peered":"2021-01-27T09:24:58.269128+0000","last_clean":"2021-01-27T09:24:58.269128+0000","last_became_active":"2021-01-27T09:24:38.292060+0000","last_became_peered":"2021-01-27T09:24:38.292060+0000","last_unstale":"2021-01-27T09:24:58.269128+0000","last_undegraded":"2021-01-27T09:24:58.269128+0000","last_fullsized":"2021-01-27T09:24:58.269128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208677+0000","last_change":"2021-01-27T09:24:42.778838+0000","last_active":"2021-01-27T09:24:58.208677+0000","last_peered":"2021-01-27T09:24:58.208677+0000","last_clean":"2021-01-27T09:24:58.208677+0000","last_became_active":"2021-01-27T09:24:42.778342+0000","last_became_peered":"2021-01-27T09:24:42.778342+0000","last_unstale":"2021-01-27T09:24:58.208677+0000","last_undegraded":"2021-01-27T09:24:58.208677+0000","last_fullsized":"2021-01-27T09:24:58.208677+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"54'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:16.323650+0000","last_change":"2021-01-27T09:24:40.310864+0000","last_active":"2021-01-27T09:27:16.323650+0000","last_peered":"2021-01-27T09:27:16.323650+0000","last_clean":"2021-01-27T09:27:16.323650+0000","last_became_active":"2021-01-27T09:24:40.309735+0000","last_became_peered":"2021-01-27T09:24:40.309735+0000","last_unstale":"2021-01-27T09:27:16.323650+0000","last_undegraded":"2021-01-27T09:27:16.323650+0000","last_fullsized":"2021-01-27T09:27:16.323650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"49'2","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206437+0000","last_change":"2021-01-27T09:24:22.340252+0000","last_active":"2021-01-27T09:24:58.206437+0000","last_peered":"2021-01-27T09:24:58.206437+0000","last_clean":"2021-01-27T09:24:58.206437+0000","last_became_active":"2021-01-27T09:24:22.339874+0000","last_became_peered":"2021-01-27T09:24:22.339874+0000","last_unstale":"2021-01-27T09:24:58.206437+0000","last_undegraded":"2021-01-27T09:24:58.206437+0000","last_fullsized":"2021-01-27T09:24:58.206437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212366+0000","last_change":"2021-01-27T09:24:38.630692+0000","last_active":"2021-01-27T09:24:58.212366+0000","last_peered":"2021-01-27T09:24:58.212366+0000","last_clean":"2021-01-27T09:24:58.212366+0000","last_became_active":"2021-01-27T09:24:38.629571+0000","last_became_peered":"2021-01-27T09:24:38.629571+0000","last_unstale":"2021-01-27T09:24:58.212366+0000","last_undegraded":"2021-01-27T09:24:58.212366+0000","last_fullsized":"2021-01-27T09:24:58.212366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215594+0000","last_change":"2021-01-27T09:24:42.794966+0000","last_active":"2021-01-27T09:24:58.215594+0000","last_peered":"2021-01-27T09:24:58.215594+0000","last_clean":"2021-01-27T09:24:58.215594+0000","last_became_active":"2021-01-27T09:24:42.794570+0000","last_became_peered":"2021-01-27T09:24:42.794570+0000","last_unstale":"2021-01-27T09:24:58.215594+0000","last_undegraded":"2021-01-27T09:24:58.215594+0000","last_fullsized":"2021-01-27T09:24:58.215594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206186+0000","last_change":"2021-01-27T09:24:40.324184+0000","last_active":"2021-01-27T09:24:58.206186+0000","last_peered":"2021-01-27T09:24:58.206186+0000","last_clean":"2021-01-27T09:24:58.206186+0000","last_became_active":"2021-01-27T09:24:40.321556+0000","last_became_peered":"2021-01-27T09:24:40.321556+0000","last_unstale":"2021-01-27T09:24:58.206186+0000","last_undegraded":"2021-01-27T09:24:58.206186+0000","last_fullsized":"2021-01-27T09:24:58.206186+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269269+0000","last_change":"2021-01-27T09:24:21.529791+0000","last_active":"2021-01-27T09:24:58.269269+0000","last_peered":"2021-01-27T09:24:58.269269+0000","last_clean":"2021-01-27T09:24:58.269269+0000","last_became_active":"2021-01-27T09:24:21.337365+0000","last_became_peered":"2021-01-27T09:24:21.337365+0000","last_unstale":"2021-01-27T09:24:58.269269+0000","last_undegraded":"2021-01-27T09:24:58.269269+0000","last_fullsized":"2021-01-27T09:24:58.269269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":56,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"58'14","reported_seq":"42","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214799+0000","last_change":"2021-01-27T09:24:38.630437+0000","last_active":"2021-01-27T09:24:58.214799+0000","last_peered":"2021-01-27T09:24:58.214799+0000","last_clean":"2021-01-27T09:24:58.214799+0000","last_became_active":"2021-01-27T09:24:38.629414+0000","last_became_peered":"2021-01-27T09:24:38.629414+0000","last_unstale":"2021-01-27T09:24:58.214799+0000","last_undegraded":"2021-01-27T09:24:58.214799+0000","last_fullsized":"2021-01-27T09:24:58.214799+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206264+0000","last_change":"2021-01-27T09:24:42.777689+0000","last_active":"2021-01-27T09:24:58.206264+0000","last_peered":"2021-01-27T09:24:58.206264+0000","last_clean":"2021-01-27T09:24:58.206264+0000","last_became_active":"2021-01-27T09:24:42.777348+0000","last_became_peered":"2021-01-27T09:24:42.777348+0000","last_unstale":"2021-01-27T09:24:58.206264+0000","last_undegraded":"2021-01-27T09:24:58.206264+0000","last_fullsized":"2021-01-27T09:24:58.206264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267646+0000","last_change":"2021-01-27T09:24:40.310829+0000","last_active":"2021-01-27T09:24:58.267646+0000","last_peered":"2021-01-27T09:24:58.267646+0000","last_clean":"2021-01-27T09:24:58.267646+0000","last_became_active":"2021-01-27T09:24:40.310248+0000","last_became_peered":"2021-01-27T09:24:40.310248+0000","last_unstale":"2021-01-27T09:24:58.267646+0000","last_undegraded":"2021-01-27T09:24:58.267646+0000","last_fullsized":"2021-01-27T09:24:58.267646+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"49'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210480+0000","last_change":"2021-01-27T09:24:18.295258+0000","last_active":"2021-01-27T09:24:58.210480+0000","last_peered":"2021-01-27T09:24:58.210480+0000","last_clean":"2021-01-27T09:24:58.210480+0000","last_became_active":"2021-01-27T09:24:18.294850+0000","last_became_peered":"2021-01-27T09:24:18.294850+0000","last_unstale":"2021-01-27T09:24:58.210480+0000","last_undegraded":"2021-01-27T09:24:58.210480+0000","last_fullsized":"2021-01-27T09:24:58.210480+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"58'12","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213870+0000","last_change":"2021-01-27T09:24:38.302289+0000","last_active":"2021-01-27T09:24:58.213870+0000","last_peered":"2021-01-27T09:24:58.213870+0000","last_clean":"2021-01-27T09:24:58.213870+0000","last_became_active":"2021-01-27T09:24:38.301888+0000","last_became_peered":"2021-01-27T09:24:38.301888+0000","last_unstale":"2021-01-27T09:24:58.213870+0000","last_undegraded":"2021-01-27T09:24:58.213870+0000","last_fullsized":"2021-01-27T09:24:58.213870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214345+0000","last_change":"2021-01-27T09:24:42.791070+0000","last_active":"2021-01-27T09:24:58.214345+0000","last_peered":"2021-01-27T09:24:58.214345+0000","last_clean":"2021-01-27T09:24:58.214345+0000","last_became_active":"2021-01-27T09:24:42.790767+0000","last_became_peered":"2021-01-27T09:24:42.790767+0000","last_unstale":"2021-01-27T09:24:58.214345+0000","last_undegraded":"2021-01-27T09:24:58.214345+0000","last_fullsized":"2021-01-27T09:24:58.214345+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206424+0000","last_change":"2021-01-27T09:24:40.311454+0000","last_active":"2021-01-27T09:24:58.206424+0000","last_peered":"2021-01-27T09:24:58.206424+0000","last_clean":"2021-01-27T09:24:58.206424+0000","last_became_active":"2021-01-27T09:24:40.309843+0000","last_became_peered":"2021-01-27T09:24:40.309843+0000","last_unstale":"2021-01-27T09:24:58.206424+0000","last_undegraded":"2021-01-27T09:24:58.206424+0000","last_fullsized":"2021-01-27T09:24:58.206424+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207437+0000","last_change":"2021-01-27T09:24:18.304189+0000","last_active":"2021-01-27T09:24:58.207437+0000","last_peered":"2021-01-27T09:24:58.207437+0000","last_clean":"2021-01-27T09:24:58.207437+0000","last_became_active":"2021-01-27T09:24:18.303700+0000","last_became_peered":"2021-01-27T09:24:18.303700+0000","last_unstale":"2021-01-27T09:24:58.207437+0000","last_undegraded":"2021-01-27T09:24:58.207437+0000","last_fullsized":"2021-01-27T09:24:58.207437+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"58'15","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220032+0000","last_change":"2021-01-27T09:24:38.300251+0000","last_active":"2021-01-27T09:24:58.220032+0000","last_peered":"2021-01-27T09:24:58.220032+0000","last_clean":"2021-01-27T09:24:58.220032+0000","last_became_active":"2021-01-27T09:24:38.299825+0000","last_became_peered":"2021-01-27T09:24:38.299825+0000","last_unstale":"2021-01-27T09:24:58.220032+0000","last_undegraded":"2021-01-27T09:24:58.220032+0000","last_fullsized":"2021-01-27T09:24:58.220032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210845+0000","last_change":"2021-01-27T09:24:42.789320+0000","last_active":"2021-01-27T09:24:58.210845+0000","last_peered":"2021-01-27T09:24:58.210845+0000","last_clean":"2021-01-27T09:24:58.210845+0000","last_became_active":"2021-01-27T09:24:42.788432+0000","last_became_peered":"2021-01-27T09:24:42.788432+0000","last_unstale":"2021-01-27T09:24:58.210845+0000","last_undegraded":"2021-01-27T09:24:58.210845+0000","last_fullsized":"2021-01-27T09:24:58.210845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215402+0000","last_change":"2021-01-27T09:24:40.310915+0000","last_active":"2021-01-27T09:24:58.215402+0000","last_peered":"2021-01-27T09:24:58.215402+0000","last_clean":"2021-01-27T09:24:58.215402+0000","last_became_active":"2021-01-27T09:24:40.310522+0000","last_became_peered":"2021-01-27T09:24:40.310522+0000","last_unstale":"2021-01-27T09:24:58.215402+0000","last_undegraded":"2021-01-27T09:24:58.215402+0000","last_fullsized":"2021-01-27T09:24:58.215402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.268477+0000","last_change":"2021-01-27T09:24:18.304639+0000","last_active":"2021-01-27T09:24:58.268477+0000","last_peered":"2021-01-27T09:24:58.268477+0000","last_clean":"2021-01-27T09:24:58.268477+0000","last_became_active":"2021-01-27T09:24:18.304145+0000","last_became_peered":"2021-01-27T09:24:18.304145+0000","last_unstale":"2021-01-27T09:24:58.268477+0000","last_undegraded":"2021-01-27T09:24:58.268477+0000","last_fullsized":"2021-01-27T09:24:58.268477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206405+0000","last_change":"2021-01-27T09:24:38.296997+0000","last_active":"2021-01-27T09:24:58.206405+0000","last_peered":"2021-01-27T09:24:58.206405+0000","last_clean":"2021-01-27T09:24:58.206405+0000","last_became_active":"2021-01-27T09:24:38.296276+0000","last_became_peered":"2021-01-27T09:24:38.296276+0000","last_unstale":"2021-01-27T09:24:58.206405+0000","last_undegraded":"2021-01-27T09:24:58.206405+0000","last_fullsized":"2021-01-27T09:24:58.206405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220873+0000","last_change":"2021-01-27T09:24:42.781219+0000","last_active":"2021-01-27T09:24:58.220873+0000","last_peered":"2021-01-27T09:24:58.220873+0000","last_clean":"2021-01-27T09:24:58.220873+0000","last_became_active":"2021-01-27T09:24:42.780869+0000","last_became_peered":"2021-01-27T09:24:42.780869+0000","last_unstale":"2021-01-27T09:24:58.220873+0000","last_undegraded":"2021-01-27T09:24:58.220873+0000","last_fullsized":"2021-01-27T09:24:58.220873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323797+0000","last_change":"2021-01-27T09:24:40.325006+0000","last_active":"2021-01-27T09:27:11.323797+0000","last_peered":"2021-01-27T09:27:11.323797+0000","last_clean":"2021-01-27T09:27:11.323797+0000","last_became_active":"2021-01-27T09:24:40.324634+0000","last_became_peered":"2021-01-27T09:24:40.324634+0000","last_unstale":"2021-01-27T09:27:11.323797+0000","last_undegraded":"2021-01-27T09:27:11.323797+0000","last_fullsized":"2021-01-27T09:27:11.323797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"49'1","reported_seq":"27","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217144+0000","last_change":"2021-01-27T09:24:18.301507+0000","last_active":"2021-01-27T09:24:58.217144+0000","last_peered":"2021-01-27T09:24:58.217144+0000","last_clean":"2021-01-27T09:24:58.217144+0000","last_became_active":"2021-01-27T09:24:18.296098+0000","last_became_peered":"2021-01-27T09:24:18.296098+0000","last_unstale":"2021-01-27T09:24:58.217144+0000","last_undegraded":"2021-01-27T09:24:58.217144+0000","last_fullsized":"2021-01-27T09:24:58.217144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"58'13","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210563+0000","last_change":"2021-01-27T09:24:38.631954+0000","last_active":"2021-01-27T09:24:58.210563+0000","last_peered":"2021-01-27T09:24:58.210563+0000","last_clean":"2021-01-27T09:24:58.210563+0000","last_became_active":"2021-01-27T09:24:38.631078+0000","last_became_peered":"2021-01-27T09:24:38.631078+0000","last_unstale":"2021-01-27T09:24:58.210563+0000","last_undegraded":"2021-01-27T09:24:58.210563+0000","last_fullsized":"2021-01-27T09:24:58.210563+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.211630+0000","last_change":"2021-01-27T09:24:42.796360+0000","last_active":"2021-01-27T09:24:58.211630+0000","last_peered":"2021-01-27T09:24:58.211630+0000","last_clean":"2021-01-27T09:24:58.211630+0000","last_became_active":"2021-01-27T09:24:42.795966+0000","last_became_peered":"2021-01-27T09:24:42.795966+0000","last_unstale":"2021-01-27T09:24:58.211630+0000","last_undegraded":"2021-01-27T09:24:58.211630+0000","last_fullsized":"2021-01-27T09:24:58.211630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:16.323692+0000","last_change":"2021-01-27T09:24:40.315281+0000","last_active":"2021-01-27T09:27:16.323692+0000","last_peered":"2021-01-27T09:27:16.323692+0000","last_clean":"2021-01-27T09:27:16.323692+0000","last_became_active":"2021-01-27T09:24:40.314904+0000","last_became_peered":"2021-01-27T09:24:40.314904+0000","last_unstale":"2021-01-27T09:27:16.323692+0000","last_undegraded":"2021-01-27T09:27:16.323692+0000","last_fullsized":"2021-01-27T09:27:16.323692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207235+0000","last_change":"2021-01-27T09:24:22.356675+0000","last_active":"2021-01-27T09:24:58.207235+0000","last_peered":"2021-01-27T09:24:58.207235+0000","last_clean":"2021-01-27T09:24:58.207235+0000","last_became_active":"2021-01-27T09:24:22.339890+0000","last_became_peered":"2021-01-27T09:24:22.339890+0000","last_unstale":"2021-01-27T09:24:58.207235+0000","last_undegraded":"2021-01-27T09:24:58.207235+0000","last_fullsized":"2021-01-27T09:24:58.207235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"58'14","reported_seq":"69","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.263563+0000","last_change":"2021-01-27T09:24:59.263563+0000","last_active":"2021-01-27T09:24:59.263563+0000","last_peered":"2021-01-27T09:24:59.263563+0000","last_clean":"2021-01-27T09:24:59.263563+0000","last_became_active":"2021-01-27T09:24:59.244577+0000","last_became_peered":"2021-01-27T09:24:59.244577+0000","last_unstale":"2021-01-27T09:24:59.263563+0000","last_undegraded":"2021-01-27T09:24:59.263563+0000","last_fullsized":"2021-01-27T09:24:59.263563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7],"acting":[3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208415+0000","last_change":"2021-01-27T09:24:42.777040+0000","last_active":"2021-01-27T09:24:58.208415+0000","last_peered":"2021-01-27T09:24:58.208415+0000","last_clean":"2021-01-27T09:24:58.208415+0000","last_became_active":"2021-01-27T09:24:42.776314+0000","last_became_peered":"2021-01-27T09:24:42.776314+0000","last_unstale":"2021-01-27T09:24:58.208415+0000","last_undegraded":"2021-01-27T09:24:58.208415+0000","last_fullsized":"2021-01-27T09:24:58.208415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210256+0000","last_change":"2021-01-27T09:24:40.320927+0000","last_active":"2021-01-27T09:24:58.210256+0000","last_peered":"2021-01-27T09:24:58.210256+0000","last_clean":"2021-01-27T09:24:58.210256+0000","last_became_active":"2021-01-27T09:24:40.320538+0000","last_became_peered":"2021-01-27T09:24:40.320538+0000","last_unstale":"2021-01-27T09:24:58.210256+0000","last_undegraded":"2021-01-27T09:24:58.210256+0000","last_fullsized":"2021-01-27T09:24:58.210256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267639+0000","last_change":"2021-01-27T09:24:18.298203+0000","last_active":"2021-01-27T09:24:58.267639+0000","last_peered":"2021-01-27T09:24:58.267639+0000","last_clean":"2021-01-27T09:24:58.267639+0000","last_became_active":"2021-01-27T09:24:18.297785+0000","last_became_peered":"2021-01-27T09:24:18.297785+0000","last_unstale":"2021-01-27T09:24:58.267639+0000","last_undegraded":"2021-01-27T09:24:58.267639+0000","last_fullsized":"2021-01-27T09:24:58.267639+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"58'7","reported_seq":"28","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218210+0000","last_change":"2021-01-27T09:24:38.630716+0000","last_active":"2021-01-27T09:24:58.218210+0000","last_peered":"2021-01-27T09:24:58.218210+0000","last_clean":"2021-01-27T09:24:58.218210+0000","last_became_active":"2021-01-27T09:24:38.629694+0000","last_became_peered":"2021-01-27T09:24:38.629694+0000","last_unstale":"2021-01-27T09:24:58.218210+0000","last_undegraded":"2021-01-27T09:24:58.218210+0000","last_fullsized":"2021-01-27T09:24:58.218210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214270+0000","last_change":"2021-01-27T09:24:42.776005+0000","last_active":"2021-01-27T09:24:58.214270+0000","last_peered":"2021-01-27T09:24:58.214270+0000","last_clean":"2021-01-27T09:24:58.214270+0000","last_became_active":"2021-01-27T09:24:42.775642+0000","last_became_peered":"2021-01-27T09:24:42.775642+0000","last_unstale":"2021-01-27T09:24:58.214270+0000","last_undegraded":"2021-01-27T09:24:58.214270+0000","last_fullsized":"2021-01-27T09:24:58.214270+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218148+0000","last_change":"2021-01-27T09:24:40.308558+0000","last_active":"2021-01-27T09:24:58.218148+0000","last_peered":"2021-01-27T09:24:58.218148+0000","last_clean":"2021-01-27T09:24:58.218148+0000","last_became_active":"2021-01-27T09:24:40.308159+0000","last_became_peered":"2021-01-27T09:24:40.308159+0000","last_unstale":"2021-01-27T09:24:58.218148+0000","last_undegraded":"2021-01-27T09:24:58.218148+0000","last_fullsized":"2021-01-27T09:24:58.218148+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212160+0000","last_change":"2021-01-27T09:24:18.312772+0000","last_active":"2021-01-27T09:24:58.212160+0000","last_peered":"2021-01-27T09:24:58.212160+0000","last_clean":"2021-01-27T09:24:58.212160+0000","last_became_active":"2021-01-27T09:24:18.312377+0000","last_became_peered":"2021-01-27T09:24:18.312377+0000","last_unstale":"2021-01-27T09:24:58.212160+0000","last_undegraded":"2021-01-27T09:24:58.212160+0000","last_fullsized":"2021-01-27T09:24:58.212160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"58'16","reported_seq":"47","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212126+0000","last_change":"2021-01-27T09:24:38.628517+0000","last_active":"2021-01-27T09:24:58.212126+0000","last_peered":"2021-01-27T09:24:58.212126+0000","last_clean":"2021-01-27T09:24:58.212126+0000","last_became_active":"2021-01-27T09:24:38.627443+0000","last_became_peered":"2021-01-27T09:24:38.627443+0000","last_unstale":"2021-01-27T09:24:58.212126+0000","last_undegraded":"2021-01-27T09:24:58.212126+0000","last_fullsized":"2021-01-27T09:24:58.212126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215484+0000","last_change":"2021-01-27T09:24:42.792701+0000","last_active":"2021-01-27T09:24:58.215484+0000","last_peered":"2021-01-27T09:24:58.215484+0000","last_clean":"2021-01-27T09:24:58.215484+0000","last_became_active":"2021-01-27T09:24:42.792213+0000","last_became_peered":"2021-01-27T09:24:42.792213+0000","last_unstale":"2021-01-27T09:24:58.215484+0000","last_undegraded":"2021-01-27T09:24:58.215484+0000","last_fullsized":"2021-01-27T09:24:58.215484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220707+0000","last_change":"2021-01-27T09:24:22.340639+0000","last_active":"2021-01-27T09:24:58.220707+0000","last_peered":"2021-01-27T09:24:58.220707+0000","last_clean":"2021-01-27T09:24:58.220707+0000","last_became_active":"2021-01-27T09:24:22.340155+0000","last_became_peered":"2021-01-27T09:24:22.340155+0000","last_unstale":"2021-01-27T09:24:58.220707+0000","last_undegraded":"2021-01-27T09:24:58.220707+0000","last_fullsized":"2021-01-27T09:24:58.220707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"58'15","reported_seq":"46","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219227+0000","last_change":"2021-01-27T09:24:38.307923+0000","last_active":"2021-01-27T09:24:58.219227+0000","last_peered":"2021-01-27T09:24:58.219227+0000","last_clean":"2021-01-27T09:24:58.219227+0000","last_became_active":"2021-01-27T09:24:38.307523+0000","last_became_peered":"2021-01-27T09:24:38.307523+0000","last_unstale":"2021-01-27T09:24:58.219227+0000","last_undegraded":"2021-01-27T09:24:58.219227+0000","last_fullsized":"2021-01-27T09:24:58.219227+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212327+0000","last_change":"2021-01-27T09:24:40.317978+0000","last_active":"2021-01-27T09:24:58.212327+0000","last_peered":"2021-01-27T09:24:58.212327+0000","last_clean":"2021-01-27T09:24:58.212327+0000","last_became_active":"2021-01-27T09:24:40.317404+0000","last_became_peered":"2021-01-27T09:24:40.317404+0000","last_unstale":"2021-01-27T09:24:58.212327+0000","last_undegraded":"2021-01-27T09:24:58.212327+0000","last_fullsized":"2021-01-27T09:24:58.212327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210953+0000","last_change":"2021-01-27T09:24:42.793057+0000","last_active":"2021-01-27T09:24:58.210953+0000","last_peered":"2021-01-27T09:24:58.210953+0000","last_clean":"2021-01-27T09:24:58.210953+0000","last_became_active":"2021-01-27T09:24:42.792693+0000","last_became_peered":"2021-01-27T09:24:42.792693+0000","last_unstale":"2021-01-27T09:24:58.210953+0000","last_undegraded":"2021-01-27T09:24:58.210953+0000","last_fullsized":"2021-01-27T09:24:58.210953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209771+0000","last_change":"2021-01-27T09:24:22.333743+0000","last_active":"2021-01-27T09:24:58.209771+0000","last_peered":"2021-01-27T09:24:58.209771+0000","last_clean":"2021-01-27T09:24:58.209771+0000","last_became_active":"2021-01-27T09:24:22.333212+0000","last_became_peered":"2021-01-27T09:24:22.333212+0000","last_unstale":"2021-01-27T09:24:58.209771+0000","last_undegraded":"2021-01-27T09:24:58.209771+0000","last_fullsized":"2021-01-27T09:24:58.209771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206590+0000","last_change":"2021-01-27T09:24:38.303258+0000","last_active":"2021-01-27T09:24:58.206590+0000","last_peered":"2021-01-27T09:24:58.206590+0000","last_clean":"2021-01-27T09:24:58.206590+0000","last_became_active":"2021-01-27T09:24:38.302390+0000","last_became_peered":"2021-01-27T09:24:38.302390+0000","last_unstale":"2021-01-27T09:24:58.206590+0000","last_undegraded":"2021-01-27T09:24:58.206590+0000","last_fullsized":"2021-01-27T09:24:58.206590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:16.324041+0000","last_change":"2021-01-27T09:24:40.309812+0000","last_active":"2021-01-27T09:27:16.324041+0000","last_peered":"2021-01-27T09:27:16.324041+0000","last_clean":"2021-01-27T09:27:16.324041+0000","last_became_active":"2021-01-27T09:24:40.309262+0000","last_became_peered":"2021-01-27T09:24:40.309262+0000","last_unstale":"2021-01-27T09:27:16.324041+0000","last_undegraded":"2021-01-27T09:27:16.324041+0000","last_fullsized":"2021-01-27T09:27:16.324041+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.218330+0000","last_change":"2021-01-27T09:24:42.784858+0000","last_active":"2021-01-27T09:24:58.218330+0000","last_peered":"2021-01-27T09:24:58.218330+0000","last_clean":"2021-01-27T09:24:58.218330+0000","last_became_active":"2021-01-27T09:24:42.784432+0000","last_became_peered":"2021-01-27T09:24:42.784432+0000","last_unstale":"2021-01-27T09:24:58.218330+0000","last_undegraded":"2021-01-27T09:24:58.218330+0000","last_fullsized":"2021-01-27T09:24:58.218330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207352+0000","last_change":"2021-01-27T09:24:18.293578+0000","last_active":"2021-01-27T09:24:58.207352+0000","last_peered":"2021-01-27T09:24:58.207352+0000","last_clean":"2021-01-27T09:24:58.207352+0000","last_became_active":"2021-01-27T09:24:18.292971+0000","last_became_peered":"2021-01-27T09:24:18.292971+0000","last_unstale":"2021-01-27T09:24:58.207352+0000","last_undegraded":"2021-01-27T09:24:58.207352+0000","last_fullsized":"2021-01-27T09:24:58.207352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"58'25","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209920+0000","last_change":"2021-01-27T09:24:38.296684+0000","last_active":"2021-01-27T09:24:58.209920+0000","last_peered":"2021-01-27T09:24:58.209920+0000","last_clean":"2021-01-27T09:24:58.209920+0000","last_became_active":"2021-01-27T09:24:38.296322+0000","last_became_peered":"2021-01-27T09:24:38.296322+0000","last_unstale":"2021-01-27T09:24:58.209920+0000","last_undegraded":"2021-01-27T09:24:58.209920+0000","last_fullsized":"2021-01-27T09:24:58.209920+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217485+0000","last_change":"2021-01-27T09:24:40.312836+0000","last_active":"2021-01-27T09:24:58.217485+0000","last_peered":"2021-01-27T09:24:58.217485+0000","last_clean":"2021-01-27T09:24:58.217485+0000","last_became_active":"2021-01-27T09:24:40.312422+0000","last_became_peered":"2021-01-27T09:24:40.312422+0000","last_unstale":"2021-01-27T09:24:58.217485+0000","last_undegraded":"2021-01-27T09:24:58.217485+0000","last_fullsized":"2021-01-27T09:24:58.217485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208662+0000","last_change":"2021-01-27T09:24:42.787229+0000","last_active":"2021-01-27T09:24:58.208662+0000","last_peered":"2021-01-27T09:24:58.208662+0000","last_clean":"2021-01-27T09:24:58.208662+0000","last_became_active":"2021-01-27T09:24:42.786852+0000","last_became_peered":"2021-01-27T09:24:42.786852+0000","last_unstale":"2021-01-27T09:24:58.208662+0000","last_undegraded":"2021-01-27T09:24:58.208662+0000","last_fullsized":"2021-01-27T09:24:58.208662+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"58'5","reported_seq":"172","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:18.251583+0000","last_change":"2021-01-27T09:24:37.280106+0000","last_active":"2021-01-27T09:27:18.251583+0000","last_peered":"2021-01-27T09:27:18.251583+0000","last_clean":"2021-01-27T09:27:18.251583+0000","last_became_active":"2021-01-27T09:24:37.279679+0000","last_became_peered":"2021-01-27T09:24:37.279679+0000","last_unstale":"2021-01-27T09:27:18.251583+0000","last_undegraded":"2021-01-27T09:27:18.251583+0000","last_fullsized":"2021-01-27T09:27:18.251583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212205+0000","last_change":"2021-01-27T09:24:18.305354+0000","last_active":"2021-01-27T09:24:58.212205+0000","last_peered":"2021-01-27T09:24:58.212205+0000","last_clean":"2021-01-27T09:24:58.212205+0000","last_became_active":"2021-01-27T09:24:18.304993+0000","last_became_peered":"2021-01-27T09:24:18.304993+0000","last_unstale":"2021-01-27T09:24:58.212205+0000","last_undegraded":"2021-01-27T09:24:58.212205+0000","last_fullsized":"2021-01-27T09:24:58.212205+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'15","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207706+0000","last_change":"2021-01-27T09:24:38.299461+0000","last_active":"2021-01-27T09:24:58.207706+0000","last_peered":"2021-01-27T09:24:58.207706+0000","last_clean":"2021-01-27T09:24:58.207706+0000","last_became_active":"2021-01-27T09:24:38.297793+0000","last_became_peered":"2021-01-27T09:24:38.297793+0000","last_unstale":"2021-01-27T09:24:58.207706+0000","last_undegraded":"2021-01-27T09:24:58.207706+0000","last_fullsized":"2021-01-27T09:24:58.207706+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212903+0000","last_change":"2021-01-27T09:24:40.322661+0000","last_active":"2021-01-27T09:24:58.212903+0000","last_peered":"2021-01-27T09:24:58.212903+0000","last_clean":"2021-01-27T09:24:58.212903+0000","last_became_active":"2021-01-27T09:24:40.322233+0000","last_became_peered":"2021-01-27T09:24:40.322233+0000","last_unstale":"2021-01-27T09:24:58.212903+0000","last_undegraded":"2021-01-27T09:24:58.212903+0000","last_fullsized":"2021-01-27T09:24:58.212903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210272+0000","last_change":"2021-01-27T09:24:42.787602+0000","last_active":"2021-01-27T09:24:58.210272+0000","last_peered":"2021-01-27T09:24:58.210272+0000","last_clean":"2021-01-27T09:24:58.210272+0000","last_became_active":"2021-01-27T09:24:42.787218+0000","last_became_peered":"2021-01-27T09:24:42.787218+0000","last_unstale":"2021-01-27T09:24:58.210272+0000","last_undegraded":"2021-01-27T09:24:58.210272+0000","last_fullsized":"2021-01-27T09:24:58.210272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"18","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214593+0000","last_change":"2021-01-27T09:24:37.286130+0000","last_active":"2021-01-27T09:24:58.214593+0000","last_peered":"2021-01-27T09:24:58.214593+0000","last_clean":"2021-01-27T09:24:58.214593+0000","last_became_active":"2021-01-27T09:24:37.285384+0000","last_became_peered":"2021-01-27T09:24:37.285384+0000","last_unstale":"2021-01-27T09:24:58.214593+0000","last_undegraded":"2021-01-27T09:24:58.214593+0000","last_fullsized":"2021-01-27T09:24:58.214593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209594+0000","last_change":"2021-01-27T09:24:22.338687+0000","last_active":"2021-01-27T09:24:58.209594+0000","last_peered":"2021-01-27T09:24:58.209594+0000","last_clean":"2021-01-27T09:24:58.209594+0000","last_became_active":"2021-01-27T09:24:22.338252+0000","last_became_peered":"2021-01-27T09:24:22.338252+0000","last_unstale":"2021-01-27T09:24:58.209594+0000","last_undegraded":"2021-01-27T09:24:58.209594+0000","last_fullsized":"2021-01-27T09:24:58.209594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205854+0000","last_change":"2021-01-27T09:24:22.341733+0000","last_active":"2021-01-27T09:24:58.205854+0000","last_peered":"2021-01-27T09:24:58.205854+0000","last_clean":"2021-01-27T09:24:58.205854+0000","last_became_active":"2021-01-27T09:24:22.341302+0000","last_became_peered":"2021-01-27T09:24:22.341302+0000","last_unstale":"2021-01-27T09:24:58.205854+0000","last_undegraded":"2021-01-27T09:24:58.205854+0000","last_fullsized":"2021-01-27T09:24:58.205854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:19:51.511232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:19:51.511232+0000","last_clean_scrub_stamp":"2021-01-27T09:19:51.511232+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"58'15","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.268833+0000","last_change":"2021-01-27T09:24:38.633243+0000","last_active":"2021-01-27T09:24:58.268833+0000","last_peered":"2021-01-27T09:24:58.268833+0000","last_clean":"2021-01-27T09:24:58.268833+0000","last_became_active":"2021-01-27T09:24:38.632759+0000","last_became_peered":"2021-01-27T09:24:38.632759+0000","last_unstale":"2021-01-27T09:24:58.268833+0000","last_undegraded":"2021-01-27T09:24:58.268833+0000","last_fullsized":"2021-01-27T09:24:58.268833+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208546+0000","last_change":"2021-01-27T09:24:40.327138+0000","last_active":"2021-01-27T09:24:58.208546+0000","last_peered":"2021-01-27T09:24:58.208546+0000","last_clean":"2021-01-27T09:24:58.208546+0000","last_became_active":"2021-01-27T09:24:40.326696+0000","last_became_peered":"2021-01-27T09:24:40.326696+0000","last_unstale":"2021-01-27T09:24:58.208546+0000","last_undegraded":"2021-01-27T09:24:58.208546+0000","last_fullsized":"2021-01-27T09:24:58.208546+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207820+0000","last_change":"2021-01-27T09:24:42.785508+0000","last_active":"2021-01-27T09:24:58.207820+0000","last_peered":"2021-01-27T09:24:58.207820+0000","last_clean":"2021-01-27T09:24:58.207820+0000","last_became_active":"2021-01-27T09:24:42.785088+0000","last_became_peered":"2021-01-27T09:24:42.785088+0000","last_unstale":"2021-01-27T09:24:58.207820+0000","last_undegraded":"2021-01-27T09:24:58.207820+0000","last_fullsized":"2021-01-27T09:24:58.207820+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"18","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217841+0000","last_change":"2021-01-27T09:24:37.288205+0000","last_active":"2021-01-27T09:24:58.217841+0000","last_peered":"2021-01-27T09:24:58.217841+0000","last_clean":"2021-01-27T09:24:58.217841+0000","last_became_active":"2021-01-27T09:24:37.287744+0000","last_became_peered":"2021-01-27T09:24:37.287744+0000","last_unstale":"2021-01-27T09:24:58.217841+0000","last_undegraded":"2021-01-27T09:24:58.217841+0000","last_fullsized":"2021-01-27T09:24:58.217841+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:36.257807+0000","last_clean_scrub_stamp":"2021-01-27T09:24:36.257807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205908+0000","last_change":"2021-01-27T09:24:22.340916+0000","last_active":"2021-01-27T09:24:58.205908+0000","last_peered":"2021-01-27T09:24:58.205908+0000","last_clean":"2021-01-27T09:24:58.205908+0000","last_became_active":"2021-01-27T09:24:22.340344+0000","last_became_peered":"2021-01-27T09:24:22.340344+0000","last_unstale":"2021-01-27T09:24:58.205908+0000","last_undegraded":"2021-01-27T09:24:58.205908+0000","last_fullsized":"2021-01-27T09:24:58.205908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"58'16","reported_seq":"74","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.612695+0000","last_change":"2021-01-27T09:24:59.612695+0000","last_active":"2021-01-27T09:24:59.612695+0000","last_peered":"2021-01-27T09:24:59.612695+0000","last_clean":"2021-01-27T09:24:59.612695+0000","last_became_active":"2021-01-27T09:24:59.248817+0000","last_became_peered":"2021-01-27T09:24:59.248817+0000","last_unstale":"2021-01-27T09:24:59.612695+0000","last_undegraded":"2021-01-27T09:24:59.612695+0000","last_fullsized":"2021-01-27T09:24:59.612695+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":630,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210572+0000","last_change":"2021-01-27T09:24:40.316548+0000","last_active":"2021-01-27T09:24:58.210572+0000","last_peered":"2021-01-27T09:24:58.210572+0000","last_clean":"2021-01-27T09:24:58.210572+0000","last_became_active":"2021-01-27T09:24:40.316165+0000","last_became_peered":"2021-01-27T09:24:40.316165+0000","last_unstale":"2021-01-27T09:24:58.210572+0000","last_undegraded":"2021-01-27T09:24:58.210572+0000","last_fullsized":"2021-01-27T09:24:58.210572+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205369+0000","last_change":"2021-01-27T09:24:42.779068+0000","last_active":"2021-01-27T09:24:58.205369+0000","last_peered":"2021-01-27T09:24:58.205369+0000","last_clean":"2021-01-27T09:24:58.205369+0000","last_became_active":"2021-01-27T09:24:42.778704+0000","last_became_peered":"2021-01-27T09:24:42.778704+0000","last_unstale":"2021-01-27T09:24:58.205369+0000","last_undegraded":"2021-01-27T09:24:58.205369+0000","last_fullsized":"2021-01-27T09:24:58.205369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208809+0000","last_change":"2021-01-27T09:24:22.339379+0000","last_active":"2021-01-27T09:24:58.208809+0000","last_peered":"2021-01-27T09:24:58.208809+0000","last_clean":"2021-01-27T09:24:58.208809+0000","last_became_active":"2021-01-27T09:24:22.337561+0000","last_became_peered":"2021-01-27T09:24:22.337561+0000","last_unstale":"2021-01-27T09:24:58.208809+0000","last_undegraded":"2021-01-27T09:24:58.208809+0000","last_fullsized":"2021-01-27T09:24:58.208809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"58'21","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217032+0000","last_change":"2021-01-27T09:24:38.632702+0000","last_active":"2021-01-27T09:24:58.217032+0000","last_peered":"2021-01-27T09:24:58.217032+0000","last_clean":"2021-01-27T09:24:58.217032+0000","last_became_active":"2021-01-27T09:24:38.631610+0000","last_became_peered":"2021-01-27T09:24:38.631610+0000","last_unstale":"2021-01-27T09:24:58.217032+0000","last_undegraded":"2021-01-27T09:24:58.217032+0000","last_fullsized":"2021-01-27T09:24:58.217032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267772+0000","last_change":"2021-01-27T09:24:40.316040+0000","last_active":"2021-01-27T09:24:58.267772+0000","last_peered":"2021-01-27T09:24:58.267772+0000","last_clean":"2021-01-27T09:24:58.267772+0000","last_became_active":"2021-01-27T09:24:40.313324+0000","last_became_peered":"2021-01-27T09:24:40.313324+0000","last_unstale":"2021-01-27T09:24:58.267772+0000","last_undegraded":"2021-01-27T09:24:58.267772+0000","last_fullsized":"2021-01-27T09:24:58.267772+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220083+0000","last_change":"2021-01-27T09:24:42.788240+0000","last_active":"2021-01-27T09:24:58.220083+0000","last_peered":"2021-01-27T09:24:58.220083+0000","last_clean":"2021-01-27T09:24:58.220083+0000","last_became_active":"2021-01-27T09:24:42.787595+0000","last_became_peered":"2021-01-27T09:24:42.787595+0000","last_unstale":"2021-01-27T09:24:58.220083+0000","last_undegraded":"2021-01-27T09:24:58.220083+0000","last_fullsized":"2021-01-27T09:24:58.220083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207316+0000","last_change":"2021-01-27T09:24:21.329375+0000","last_active":"2021-01-27T09:24:58.207316+0000","last_peered":"2021-01-27T09:24:58.207316+0000","last_clean":"2021-01-27T09:24:58.207316+0000","last_became_active":"2021-01-27T09:24:21.328834+0000","last_became_peered":"2021-01-27T09:24:21.328834+0000","last_unstale":"2021-01-27T09:24:58.207316+0000","last_undegraded":"2021-01-27T09:24:58.207316+0000","last_fullsized":"2021-01-27T09:24:58.207316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"58'22","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213723+0000","last_change":"2021-01-27T09:24:38.633762+0000","last_active":"2021-01-27T09:24:58.213723+0000","last_peered":"2021-01-27T09:24:58.213723+0000","last_clean":"2021-01-27T09:24:58.213723+0000","last_became_active":"2021-01-27T09:24:38.632507+0000","last_became_peered":"2021-01-27T09:24:38.632507+0000","last_unstale":"2021-01-27T09:24:58.213723+0000","last_undegraded":"2021-01-27T09:24:58.213723+0000","last_fullsized":"2021-01-27T09:24:58.213723+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219413+0000","last_change":"2021-01-27T09:24:40.313175+0000","last_active":"2021-01-27T09:24:58.219413+0000","last_peered":"2021-01-27T09:24:58.219413+0000","last_clean":"2021-01-27T09:24:58.219413+0000","last_became_active":"2021-01-27T09:24:40.312483+0000","last_became_peered":"2021-01-27T09:24:40.312483+0000","last_unstale":"2021-01-27T09:24:58.219413+0000","last_undegraded":"2021-01-27T09:24:58.219413+0000","last_fullsized":"2021-01-27T09:24:58.219413+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207358+0000","last_change":"2021-01-27T09:24:42.777912+0000","last_active":"2021-01-27T09:24:58.207358+0000","last_peered":"2021-01-27T09:24:58.207358+0000","last_clean":"2021-01-27T09:24:58.207358+0000","last_became_active":"2021-01-27T09:24:42.777540+0000","last_became_peered":"2021-01-27T09:24:42.777540+0000","last_unstale":"2021-01-27T09:24:58.207358+0000","last_undegraded":"2021-01-27T09:24:58.207358+0000","last_fullsized":"2021-01-27T09:24:58.207358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.269398+0000","last_change":"2021-01-27T09:24:22.343498+0000","last_active":"2021-01-27T09:24:58.269398+0000","last_peered":"2021-01-27T09:24:58.269398+0000","last_clean":"2021-01-27T09:24:58.269398+0000","last_became_active":"2021-01-27T09:24:22.342471+0000","last_became_peered":"2021-01-27T09:24:22.342471+0000","last_unstale":"2021-01-27T09:24:58.269398+0000","last_undegraded":"2021-01-27T09:24:58.269398+0000","last_fullsized":"2021-01-27T09:24:58.269398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"58'20","reported_seq":"50","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219164+0000","last_change":"2021-01-27T09:24:38.292564+0000","last_active":"2021-01-27T09:24:58.219164+0000","last_peered":"2021-01-27T09:24:58.219164+0000","last_clean":"2021-01-27T09:24:58.219164+0000","last_became_active":"2021-01-27T09:24:38.292081+0000","last_became_peered":"2021-01-27T09:24:38.292081+0000","last_unstale":"2021-01-27T09:24:58.219164+0000","last_undegraded":"2021-01-27T09:24:58.219164+0000","last_fullsized":"2021-01-27T09:24:58.219164+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.323573+0000","last_change":"2021-01-27T09:24:40.313222+0000","last_active":"2021-01-27T09:27:11.323573+0000","last_peered":"2021-01-27T09:27:11.323573+0000","last_clean":"2021-01-27T09:27:11.323573+0000","last_became_active":"2021-01-27T09:24:40.312883+0000","last_became_peered":"2021-01-27T09:24:40.312883+0000","last_unstale":"2021-01-27T09:27:11.323573+0000","last_undegraded":"2021-01-27T09:27:11.323573+0000","last_fullsized":"2021-01-27T09:27:11.323573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.215825+0000","last_change":"2021-01-27T09:24:42.793948+0000","last_active":"2021-01-27T09:24:58.215825+0000","last_peered":"2021-01-27T09:24:58.215825+0000","last_clean":"2021-01-27T09:24:58.215825+0000","last_became_active":"2021-01-27T09:24:42.793603+0000","last_became_peered":"2021-01-27T09:24:42.793603+0000","last_unstale":"2021-01-27T09:24:58.215825+0000","last_undegraded":"2021-01-27T09:24:58.215825+0000","last_fullsized":"2021-01-27T09:24:58.215825+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.210501+0000","last_change":"2021-01-27T09:24:40.320901+0000","last_active":"2021-01-27T09:24:58.210501+0000","last_peered":"2021-01-27T09:24:58.210501+0000","last_clean":"2021-01-27T09:24:58.210501+0000","last_became_active":"2021-01-27T09:24:40.320432+0000","last_became_peered":"2021-01-27T09:24:40.320432+0000","last_unstale":"2021-01-27T09:24:58.210501+0000","last_undegraded":"2021-01-27T09:24:58.210501+0000","last_fullsized":"2021-01-27T09:24:58.210501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"21","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205960+0000","last_change":"2021-01-27T09:24:22.339193+0000","last_active":"2021-01-27T09:24:58.205960+0000","last_peered":"2021-01-27T09:24:58.205960+0000","last_clean":"2021-01-27T09:24:58.205960+0000","last_became_active":"2021-01-27T09:24:22.338701+0000","last_became_peered":"2021-01-27T09:24:22.338701+0000","last_unstale":"2021-01-27T09:24:58.205960+0000","last_undegraded":"2021-01-27T09:24:58.205960+0000","last_fullsized":"2021-01-27T09:24:58.205960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"58'15","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220288+0000","last_change":"2021-01-27T09:24:38.298903+0000","last_active":"2021-01-27T09:24:58.220288+0000","last_peered":"2021-01-27T09:24:58.220288+0000","last_clean":"2021-01-27T09:24:58.220288+0000","last_became_active":"2021-01-27T09:24:38.298528+0000","last_became_peered":"2021-01-27T09:24:38.298528+0000","last_unstale":"2021-01-27T09:24:58.220288+0000","last_undegraded":"2021-01-27T09:24:58.220288+0000","last_fullsized":"2021-01-27T09:24:58.220288+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.209936+0000","last_change":"2021-01-27T09:24:42.783494+0000","last_active":"2021-01-27T09:24:58.209936+0000","last_peered":"2021-01-27T09:24:58.209936+0000","last_clean":"2021-01-27T09:24:58.209936+0000","last_became_active":"2021-01-27T09:24:42.783113+0000","last_became_peered":"2021-01-27T09:24:42.783113+0000","last_unstale":"2021-01-27T09:24:58.209936+0000","last_undegraded":"2021-01-27T09:24:58.209936+0000","last_fullsized":"2021-01-27T09:24:58.209936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"54'2","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:11.322811+0000","last_change":"2021-01-27T09:24:40.315373+0000","last_active":"2021-01-27T09:27:11.322811+0000","last_peered":"2021-01-27T09:27:11.322811+0000","last_clean":"2021-01-27T09:27:11.322811+0000","last_became_active":"2021-01-27T09:24:40.314979+0000","last_became_peered":"2021-01-27T09:24:40.314979+0000","last_unstale":"2021-01-27T09:27:11.322811+0000","last_undegraded":"2021-01-27T09:27:11.322811+0000","last_fullsized":"2021-01-27T09:27:11.322811+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205888+0000","last_change":"2021-01-27T09:24:22.333175+0000","last_active":"2021-01-27T09:24:58.205888+0000","last_peered":"2021-01-27T09:24:58.205888+0000","last_clean":"2021-01-27T09:24:58.205888+0000","last_became_active":"2021-01-27T09:24:22.332657+0000","last_became_peered":"2021-01-27T09:24:22.332657+0000","last_unstale":"2021-01-27T09:24:58.205888+0000","last_undegraded":"2021-01-27T09:24:58.205888+0000","last_fullsized":"2021-01-27T09:24:58.205888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"58'17","reported_seq":"46","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208116+0000","last_change":"2021-01-27T09:24:38.303648+0000","last_active":"2021-01-27T09:24:58.208116+0000","last_peered":"2021-01-27T09:24:58.208116+0000","last_clean":"2021-01-27T09:24:58.208116+0000","last_became_active":"2021-01-27T09:24:38.303107+0000","last_became_peered":"2021-01-27T09:24:38.303107+0000","last_unstale":"2021-01-27T09:24:58.208116+0000","last_undegraded":"2021-01-27T09:24:58.208116+0000","last_fullsized":"2021-01-27T09:24:58.208116+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220535+0000","last_change":"2021-01-27T09:24:42.780897+0000","last_active":"2021-01-27T09:24:58.220535+0000","last_peered":"2021-01-27T09:24:58.220535+0000","last_clean":"2021-01-27T09:24:58.220535+0000","last_became_active":"2021-01-27T09:24:42.780487+0000","last_became_peered":"2021-01-27T09:24:42.780487+0000","last_unstale":"2021-01-27T09:24:58.220535+0000","last_undegraded":"2021-01-27T09:24:58.220535+0000","last_fullsized":"2021-01-27T09:24:58.220535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:16.323634+0000","last_change":"2021-01-27T09:24:40.325088+0000","last_active":"2021-01-27T09:27:16.323634+0000","last_peered":"2021-01-27T09:27:16.323634+0000","last_clean":"2021-01-27T09:27:16.323634+0000","last_became_active":"2021-01-27T09:24:40.324601+0000","last_became_peered":"2021-01-27T09:24:40.324601+0000","last_unstale":"2021-01-27T09:27:16.323634+0000","last_undegraded":"2021-01-27T09:27:16.323634+0000","last_fullsized":"2021-01-27T09:27:16.323634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"45'1","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205446+0000","last_change":"2021-01-27T09:24:22.347978+0000","last_active":"2021-01-27T09:24:58.205446+0000","last_peered":"2021-01-27T09:24:58.205446+0000","last_clean":"2021-01-27T09:24:58.205446+0000","last_became_active":"2021-01-27T09:24:22.333068+0000","last_became_peered":"2021-01-27T09:24:22.333068+0000","last_unstale":"2021-01-27T09:24:58.205446+0000","last_undegraded":"2021-01-27T09:24:58.205446+0000","last_fullsized":"2021-01-27T09:24:58.205446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"58'13","reported_seq":"38","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.219839+0000","last_change":"2021-01-27T09:24:38.300331+0000","last_active":"2021-01-27T09:24:58.219839+0000","last_peered":"2021-01-27T09:24:58.219839+0000","last_clean":"2021-01-27T09:24:58.219839+0000","last_became_active":"2021-01-27T09:24:38.299986+0000","last_became_peered":"2021-01-27T09:24:38.299986+0000","last_unstale":"2021-01-27T09:24:58.219839+0000","last_undegraded":"2021-01-27T09:24:58.219839+0000","last_fullsized":"2021-01-27T09:24:58.219839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.213812+0000","last_change":"2021-01-27T09:24:42.786403+0000","last_active":"2021-01-27T09:24:58.213812+0000","last_peered":"2021-01-27T09:24:58.213812+0000","last_clean":"2021-01-27T09:24:58.213812+0000","last_became_active":"2021-01-27T09:24:42.786004+0000","last_became_peered":"2021-01-27T09:24:42.786004+0000","last_unstale":"2021-01-27T09:24:58.213812+0000","last_undegraded":"2021-01-27T09:24:58.213812+0000","last_fullsized":"2021-01-27T09:24:58.213812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.208043+0000","last_change":"2021-01-27T09:24:40.315900+0000","last_active":"2021-01-27T09:24:58.208043+0000","last_peered":"2021-01-27T09:24:58.208043+0000","last_clean":"2021-01-27T09:24:58.208043+0000","last_became_active":"2021-01-27T09:24:40.315522+0000","last_became_peered":"2021-01-27T09:24:40.315522+0000","last_unstale":"2021-01-27T09:24:58.208043+0000","last_undegraded":"2021-01-27T09:24:58.208043+0000","last_fullsized":"2021-01-27T09:24:58.208043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"45'2","reported_seq":"32","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206934+0000","last_change":"2021-01-27T09:24:22.444137+0000","last_active":"2021-01-27T09:24:58.206934+0000","last_peered":"2021-01-27T09:24:58.206934+0000","last_clean":"2021-01-27T09:24:58.206934+0000","last_became_active":"2021-01-27T09:24:22.336576+0000","last_became_peered":"2021-01-27T09:24:22.336576+0000","last_unstale":"2021-01-27T09:24:58.206934+0000","last_undegraded":"2021-01-27T09:24:58.206934+0000","last_fullsized":"2021-01-27T09:24:58.206934+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"58'21","reported_seq":"53","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.220210+0000","last_change":"2021-01-27T09:24:38.299043+0000","last_active":"2021-01-27T09:24:58.220210+0000","last_peered":"2021-01-27T09:24:58.220210+0000","last_clean":"2021-01-27T09:24:58.220210+0000","last_became_active":"2021-01-27T09:24:38.298659+0000","last_became_peered":"2021-01-27T09:24:38.298659+0000","last_unstale":"2021-01-27T09:24:58.220210+0000","last_undegraded":"2021-01-27T09:24:58.220210+0000","last_fullsized":"2021-01-27T09:24:58.220210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.205681+0000","last_change":"2021-01-27T09:24:42.788205+0000","last_active":"2021-01-27T09:24:58.205681+0000","last_peered":"2021-01-27T09:24:58.205681+0000","last_clean":"2021-01-27T09:24:58.205681+0000","last_became_active":"2021-01-27T09:24:42.787837+0000","last_became_peered":"2021-01-27T09:24:42.787837+0000","last_unstale":"2021-01-27T09:24:58.205681+0000","last_undegraded":"2021-01-27T09:24:58.205681+0000","last_fullsized":"2021-01-27T09:24:58.205681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.212607+0000","last_change":"2021-01-27T09:24:40.323945+0000","last_active":"2021-01-27T09:24:58.212607+0000","last_peered":"2021-01-27T09:24:58.212607+0000","last_clean":"2021-01-27T09:24:58.212607+0000","last_became_active":"2021-01-27T09:24:40.323506+0000","last_became_peered":"2021-01-27T09:24:40.323506+0000","last_unstale":"2021-01-27T09:24:58.212607+0000","last_undegraded":"2021-01-27T09:24:58.212607+0000","last_fullsized":"2021-01-27T09:24:58.212607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.214477+0000","last_change":"2021-01-27T09:24:18.301581+0000","last_active":"2021-01-27T09:24:58.214477+0000","last_peered":"2021-01-27T09:24:58.214477+0000","last_clean":"2021-01-27T09:24:58.214477+0000","last_became_active":"2021-01-27T09:24:18.301206+0000","last_became_peered":"2021-01-27T09:24:18.301206+0000","last_unstale":"2021-01-27T09:24:58.214477+0000","last_undegraded":"2021-01-27T09:24:58.214477+0000","last_fullsized":"2021-01-27T09:24:58.214477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"58'23","reported_seq":"56","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.267855+0000","last_change":"2021-01-27T09:24:38.632049+0000","last_active":"2021-01-27T09:24:58.267855+0000","last_peered":"2021-01-27T09:24:58.267855+0000","last_clean":"2021-01-27T09:24:58.267855+0000","last_became_active":"2021-01-27T09:24:38.631323+0000","last_became_peered":"2021-01-27T09:24:38.631323+0000","last_unstale":"2021-01-27T09:24:58.267855+0000","last_undegraded":"2021-01-27T09:24:58.267855+0000","last_fullsized":"2021-01-27T09:24:58.267855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217601+0000","last_change":"2021-01-27T09:24:42.795025+0000","last_active":"2021-01-27T09:24:58.217601+0000","last_peered":"2021-01-27T09:24:58.217601+0000","last_clean":"2021-01-27T09:24:58.217601+0000","last_became_active":"2021-01-27T09:24:42.794604+0000","last_became_peered":"2021-01-27T09:24:42.794604+0000","last_unstale":"2021-01-27T09:24:58.217601+0000","last_undegraded":"2021-01-27T09:24:58.217601+0000","last_fullsized":"2021-01-27T09:24:58.217601+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"15","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.216630+0000","last_change":"2021-01-27T09:24:40.317107+0000","last_active":"2021-01-27T09:24:58.216630+0000","last_peered":"2021-01-27T09:24:58.216630+0000","last_clean":"2021-01-27T09:24:58.216630+0000","last_became_active":"2021-01-27T09:24:40.316747+0000","last_became_peered":"2021-01-27T09:24:40.316747+0000","last_unstale":"2021-01-27T09:24:58.216630+0000","last_undegraded":"2021-01-27T09:24:58.216630+0000","last_fullsized":"2021-01-27T09:24:58.216630+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207657+0000","last_change":"2021-01-27T09:24:18.301682+0000","last_active":"2021-01-27T09:24:58.207657+0000","last_peered":"2021-01-27T09:24:58.207657+0000","last_clean":"2021-01-27T09:24:58.207657+0000","last_became_active":"2021-01-27T09:24:18.301067+0000","last_became_peered":"2021-01-27T09:24:18.301067+0000","last_unstale":"2021-01-27T09:24:58.207657+0000","last_undegraded":"2021-01-27T09:24:58.207657+0000","last_fullsized":"2021-01-27T09:24:58.207657+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'14","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.217242+0000","last_change":"2021-01-27T09:24:38.289702+0000","last_active":"2021-01-27T09:24:58.217242+0000","last_peered":"2021-01-27T09:24:58.217242+0000","last_clean":"2021-01-27T09:24:58.217242+0000","last_became_active":"2021-01-27T09:24:38.289272+0000","last_became_peered":"2021-01-27T09:24:38.289272+0000","last_unstale":"2021-01-27T09:24:58.217242+0000","last_undegraded":"2021-01-27T09:24:58.217242+0000","last_fullsized":"2021-01-27T09:24:58.217242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.207141+0000","last_change":"2021-01-27T09:24:42.782924+0000","last_active":"2021-01-27T09:24:58.207141+0000","last_peered":"2021-01-27T09:24:58.207141+0000","last_clean":"2021-01-27T09:24:58.207141+0000","last_became_active":"2021-01-27T09:24:42.782155+0000","last_became_peered":"2021-01-27T09:24:42.782155+0000","last_unstale":"2021-01-27T09:24:58.207141+0000","last_undegraded":"2021-01-27T09:24:58.207141+0000","last_fullsized":"2021-01-27T09:24:58.207141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:41.737049+0000","last_clean_scrub_stamp":"2021-01-27T09:24:41.737049+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:24:59.246250+0000","last_change":"2021-01-27T09:24:59.246250+0000","last_active":"2021-01-27T09:24:59.246250+0000","last_peered":"2021-01-27T09:24:59.246250+0000","last_clean":"2021-01-27T09:24:59.246250+0000","last_became_active":"2021-01-27T09:24:59.245765+0000","last_became_peered":"2021-01-27T09:24:59.245765+0000","last_unstale":"2021-01-27T09:24:59.246250+0000","last_undegraded":"2021-01-27T09:24:59.246250+0000","last_fullsized":"2021-01-27T09:24:59.246250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:17.266988+0000","last_clean_scrub_stamp":"2021-01-27T09:24:17.266988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"58'18","reported_seq":"48","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-27T09:24:58.206493+0000","last_change":"2021-01-27T09:24:38.633808+0000","last_active":"2021-01-27T09:24:58.206493+0000","last_peered":"2021-01-27T09:24:58.206493+0000","last_clean":"2021-01-27T09:24:58.206493+0000","last_became_active":"2021-01-27T09:24:38.633430+0000","last_became_peered":"2021-01-27T09:24:38.633430+0000","last_unstale":"2021-01-27T09:24:58.206493+0000","last_undegraded":"2021-01-27T09:24:58.206493+0000","last_fullsized":"2021-01-27T09:24:58.206493+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:37.261869+0000","last_clean_scrub_stamp":"2021-01-27T09:24:37.261869+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T09:27:16.323839+0000","last_change":"2021-01-27T09:24:40.321484+0000","last_active":"2021-01-27T09:27:16.323839+0000","last_peered":"2021-01-27T09:27:16.323839+0000","last_clean":"2021-01-27T09:27:16.323839+0000","last_became_active":"2021-01-27T09:24:40.321050+0000","last_became_peered":"2021-01-27T09:24:40.321050+0000","last_unstale":"2021-01-27T09:27:16.323839+0000","last_undegraded":"2021-01-27T09:27:16.323839+0000","last_fullsized":"2021-01-27T09:27:16.323839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:24:39.274411+0000","last_clean_scrub_stamp":"2021-01-27T09:24:39.274411+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1364,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":524,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6104,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739048,"statfs":{"total":95995035648,"available":95988785152,"internally_reserved":0,"allocated":802816,"data_stored":237490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":1.9319999999999999,"15min":1.9419999999999999},"min":{"1min":1.425,"5min":1.397,"15min":1.397},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":2.4390000000000001},{"interface":"front","average":{"1min":1.9950000000000001,"5min":1.9570000000000001,"15min":1.9510000000000001},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":1.748}]},{"osd":1,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.3450000000000002,"5min":2.097,"15min":2.0550000000000002},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":3.419,"5min":3.419,"15min":3.419},"last":2.7959999999999998},{"interface":"front","average":{"1min":2.4940000000000002,"5min":2.286,"15min":2.2509999999999999},"min":{"1min":1.6930000000000001,"5min":1.264,"15min":1.264},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":1.4490000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.0939999999999999,"5min":2.0179999999999998,"15min":2.0059999999999998},"min":{"1min":1.3340000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":3.0190000000000001,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.6519999999999999},{"interface":"front","average":{"1min":2.7599999999999998,"5min":2.5569999999999999,"15min":2.5230000000000001},"min":{"1min":1.7949999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.0289999999999999,"5min":4.0289999999999999,"15min":4.0289999999999999},"last":3.2210000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":2.4100000000000001,"15min":2.4039999999999999},"min":{"1min":1.486,"5min":1.4810000000000001,"15min":1.4810000000000001},"max":{"1min":3.6840000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":2.3530000000000002},{"interface":"front","average":{"1min":2.9940000000000002,"5min":2.8700000000000001,"15min":2.8500000000000001},"min":{"1min":2.2360000000000002,"5min":1.877,"15min":1.877},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":3.391}]},{"osd":4,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.121,"5min":2.7410000000000001,"15min":2.677},"min":{"1min":0.93600000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":5.9299999999999997,"5min":5.9299999999999997,"15min":5.9299999999999997},"last":2.2730000000000001},{"interface":"front","average":{"1min":3.0720000000000001,"5min":2.778,"15min":2.7290000000000001},"min":{"1min":2.145,"5min":1.5940000000000001,"15min":1.5940000000000001},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":1.982}]},{"osd":5,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.3650000000000002,"5min":3.1539999999999999,"15min":3.1190000000000002},"min":{"1min":1.407,"5min":1.179,"15min":1.179},"max":{"1min":5.7530000000000001,"5min":5.7530000000000001,"15min":5.7530000000000001},"last":3.0339999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.0939999999999999,"15min":3.0489999999999999},"min":{"1min":1.234,"5min":1.139,"15min":1.139},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":2.5870000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:26:26 2021","interfaces":[{"interface":"back","average":{"1min":3.5209999999999999,"5min":3.3170000000000002,"15min":3.2829999999999999},"min":{"1min":1.8839999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":2.9380000000000002},{"interface":"front","average":{"1min":3.5070000000000001,"5min":3.1349999999999998,"15min":3.073},"min":{"1min":1.9330000000000001,"5min":1.24,"15min":1.24},"max":{"1min":8.1470000000000002,"5min":8.1470000000000002,"15min":8.1470000000000002},"last":2.6779999999999999}]}]},{"osd":6,"up_from":41,"seq":176093659181,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":240233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.734,"15min":1.718},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3490000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.9990000000000001,"5min":1.9930000000000001,"15min":1.98},"min":{"1min":1.395,"5min":1.206,"15min":1.206},"max":{"1min":3.2280000000000002,"5min":3.375,"15min":3.375},"last":1.9099999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":2.3799999999999999,"15min":2.4089999999999998},"min":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.7519999999999998},{"interface":"front","average":{"1min":2.3620000000000001,"5min":2.343,"15min":2.351},"min":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":3.2440000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":1.52}]},{"osd":2,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.5739999999999998,"5min":2.6269999999999998,"15min":2.6850000000000001},"min":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"max":{"1min":3.4340000000000002,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":2.8620000000000001},{"interface":"front","average":{"1min":1.905,"5min":2.0219999999999998,"15min":2.0569999999999999},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.657,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.653}]},{"osd":3,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.786,"5min":2.778,"15min":2.8340000000000001},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.3150000000000004,"5min":4.3419999999999996,"15min":4.3419999999999996},"last":3.004},{"interface":"front","average":{"1min":3.0649999999999999,"5min":3.0800000000000001,"15min":3.1200000000000001},"min":{"1min":1.752,"5min":1.7110000000000001,"15min":1.7110000000000001},"max":{"1min":4.25,"5min":4.25,"15min":4.25},"last":2.4969999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":2.4039999999999999,"15min":2.4279999999999999},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.9249999999999998,"5min":3.161,"15min":3.161},"last":2.4020000000000001},{"interface":"front","average":{"1min":3.3559999999999999,"5min":3.2109999999999999,"15min":3.238},"min":{"1min":1.9139999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"max":{"1min":4.0830000000000002,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":3.2480000000000002}]},{"osd":5,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":2.6469999999999998,"15min":2.657},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":3.2109999999999999,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":2.1680000000000001},{"interface":"front","average":{"1min":3.1920000000000002,"5min":3.1779999999999999,"15min":3.2269999999999999},"min":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"max":{"1min":4.7800000000000002,"5min":4.782,"15min":4.782},"last":3.198}]},{"osd":7,"last update":"Wed Jan 27 09:26:22 2021","interfaces":[{"interface":"back","average":{"1min":3.5569999999999999,"5min":3.605,"15min":3.613},"min":{"1min":2.254,"5min":2.254,"15min":2.254},"max":{"1min":4.8179999999999996,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":3.6150000000000002},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.4620000000000002,"15min":3.4849999999999999},"min":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"max":{"1min":4.4790000000000001,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":3.383}]}]},{"osd":1,"up_from":16,"seq":68719476809,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6696,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738456,"statfs":{"total":95995035648,"available":95988178944,"internally_reserved":0,"allocated":950272,"data_stored":243077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.8560000000000001,"5min":1.595,"15min":1.3089999999999999},"min":{"1min":1.1779999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.6539999999999999,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.1389999999999998},{"interface":"front","average":{"1min":2.0110000000000001,"5min":1.738,"15min":1.405},"min":{"1min":0.96399999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.5700000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:27:11 2021","interfaces":[{"interface":"back","average":{"1min":2.1299999999999999,"5min":1.95,"15min":1.744},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":2.5329999999999999},{"interface":"front","average":{"1min":2.1419999999999999,"5min":2.0649999999999999,"15min":1.786},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":3.6520000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.9039999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":2.198,"15min":2.101},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.3260000000000001,"5min":3.3260000000000001,"15min":3.3260000000000001},"last":2.927},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.9359999999999999,"15min":1.9079999999999999},"min":{"1min":1.179,"5min":1.179,"15min":1.179},"max":{"1min":3.2989999999999999,"5min":3.2989999999999999,"15min":3.2989999999999999},"last":2.0699999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.8130000000000002,"5min":2.5270000000000001,"15min":2.3780000000000001},"min":{"1min":1.5660000000000001,"5min":1.327,"15min":1.327},"max":{"1min":3.601,"5min":3.863,"15min":3.863},"last":2.8410000000000002},{"interface":"front","average":{"1min":3.0129999999999999,"5min":2.7639999999999998,"15min":2.5779999999999998},"min":{"1min":1.462,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":4.1100000000000003,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":2.2250000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:26:25 2021","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":2.891,"15min":2.8290000000000002},"min":{"1min":2.1619999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":3.8250000000000002},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.0840000000000001,"15min":3.0409999999999999},"min":{"1min":1.8640000000000001,"5min":1.181,"15min":1.181},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":2.4729999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.6970000000000001,"5min":2.5840000000000001,"15min":2.5779999999999998},"min":{"1min":1.784,"5min":1.494,"15min":1.494},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":2.9950000000000001},{"interface":"front","average":{"1min":3.3119999999999998,"5min":3.1589999999999998,"15min":3.1499999999999999},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":4.2110000000000003}]},{"osd":7,"last update":"Wed Jan 27 09:26:23 2021","interfaces":[{"interface":"back","average":{"1min":3.3650000000000002,"5min":3.3690000000000002,"15min":3.3690000000000002},"min":{"1min":2.4940000000000002,"5min":1.849,"15min":1.849},"max":{"1min":4.7430000000000003,"5min":4.7430000000000003,"15min":4.7430000000000003},"last":4.5519999999999996},{"interface":"front","average":{"1min":3.4239999999999999,"5min":3.3199999999999998,"15min":3.302},"min":{"1min":1.776,"5min":1.5569999999999999,"15min":1.5569999999999999},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":2.7069999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673038,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6412,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738740,"statfs":{"total":95995035648,"available":95988469760,"internally_reserved":0,"allocated":790528,"data_stored":238133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:26:43 2021","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.704,"15min":1.4359999999999999},"min":{"1min":1.226,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.7370000000000001,"5min":3.0720000000000001,"15min":3.0720000000000001},"last":1.891},{"interface":"front","average":{"1min":2.2570000000000001,"5min":2.0550000000000002,"15min":1.7609999999999999},"min":{"1min":1.2509999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2889999999999997},"last":2.0670000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:27:19 2021","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":1.8640000000000001,"15min":1.6220000000000001},"min":{"1min":1.0409999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":4.032,"5min":4.032,"15min":4.032},"last":1.8340000000000001},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.1890000000000001,"15min":1.8029999999999999},"min":{"1min":1.107,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7690000000000001,"5min":4.048,"15min":4.048},"last":2.911}]},{"osd":3,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":1.8939999999999999,"15min":1.8200000000000001},"min":{"1min":1.4970000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":2.5110000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.974},{"interface":"front","average":{"1min":2.8969999999999998,"5min":2.5409999999999999,"15min":2.323},"min":{"1min":1.667,"5min":1.4990000000000001,"15min":1.4990000000000001},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":2.6659999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":3.0720000000000001,"5min":2.794,"15min":2.6459999999999999},"min":{"1min":2.1749999999999998,"5min":1.6479999999999999,"15min":1.6479999999999999},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":2.7749999999999999},{"interface":"front","average":{"1min":2.512,"5min":2.516,"15min":2.508},"min":{"1min":1.8280000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"max":{"1min":3.7759999999999998,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":2.5110000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":2.7229999999999999,"15min":2.653},"min":{"1min":2.1789999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":2.7109999999999999},{"interface":"front","average":{"1min":3.492,"5min":3.2589999999999999,"15min":3.1819999999999999},"min":{"1min":2.532,"5min":2.3540000000000001,"15min":2.3540000000000001},"max":{"1min":5.0090000000000003,"5min":5.0090000000000003,"15min":5.0090000000000003},"last":3.0750000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:26:59 2021","interfaces":[{"interface":"back","average":{"1min":2.8300000000000001,"5min":2.9540000000000002,"15min":2.9860000000000002},"min":{"1min":2.069,"5min":2.0350000000000001,"15min":2.0350000000000001},"max":{"1min":3.6080000000000001,"5min":4.54,"15min":4.54},"last":3.024},{"interface":"front","average":{"1min":3.4609999999999999,"5min":3.468,"15min":3.456},"min":{"1min":2.331,"5min":2.331,"15min":2.331},"max":{"1min":4.6500000000000004,"5min":4.6500000000000004,"15min":4.6500000000000004},"last":3.1720000000000002}]},{"osd":7,"last update":"Wed Jan 27 09:26:23 2021","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":3.1440000000000001,"15min":3.1589999999999998},"min":{"1min":2.1840000000000002,"5min":2.137,"15min":2.137},"max":{"1min":4,"5min":4.2590000000000003,"15min":4.2590000000000003},"last":2.8340000000000001},{"interface":"front","average":{"1min":3.6989999999999998,"5min":3.593,"15min":3.5750000000000002},"min":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"max":{"1min":4.3970000000000002,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":3.274}]}]},{"osd":2,"up_from":21,"seq":90194313284,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6156,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738996,"statfs":{"total":95995035648,"available":95988731904,"internally_reserved":0,"allocated":724992,"data_stored":234913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:27:15 2021","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.7829999999999999,"15min":1.641},"min":{"1min":1.0189999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.0089999999999999,"5min":7.2839999999999998,"15min":7.2839999999999998},"last":2.052},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.774,"15min":1.506},"min":{"1min":0.93999999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.2090000000000001,"5min":3.302,"15min":3.302},"last":1.8220000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:27:15 2021","interfaces":[{"interface":"back","average":{"1min":2.0550000000000002,"5min":2.0680000000000001,"15min":1.821},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":3.4239999999999999,"5min":4.726,"15min":4.726},"last":1.6499999999999999},{"interface":"front","average":{"1min":2.1269999999999998,"5min":1.988,"15min":1.804},"min":{"1min":1.377,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.9769999999999999,"5min":3.613,"15min":3.613},"last":2.1400000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.8620000000000001,"15min":1.823},"min":{"1min":1.218,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.2130000000000001,"5min":3.8769999999999998,"15min":3.8769999999999998},"last":2.1850000000000001},{"interface":"front","average":{"1min":2.3090000000000002,"5min":2.5310000000000001,"15min":2.3809999999999998},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.1429999999999998,"5min":7.827,"15min":7.827},"last":2.6240000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":2.8650000000000002,"15min":2.8330000000000002},"min":{"1min":1.444,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":4.1189999999999998,"5min":8.2420000000000009,"15min":8.2420000000000009},"last":2.9630000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.6549999999999998,"15min":2.6030000000000002},"min":{"1min":1.75,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":2.339}]},{"osd":5,"last update":"Wed Jan 27 09:26:32 2021","interfaces":[{"interface":"back","average":{"1min":3.2240000000000002,"5min":3.1600000000000001,"15min":3.121},"min":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"max":{"1min":8.6310000000000002,"5min":8.6310000000000002,"15min":8.6310000000000002},"last":3.423},{"interface":"front","average":{"1min":2.8740000000000001,"5min":2.9350000000000001,"15min":2.9430000000000001},"min":{"1min":1.7649999999999999,"5min":1.331,"15min":1.331},"max":{"1min":3.7269999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":2.5110000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:58 2021","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":2.5910000000000002,"15min":2.649},"min":{"1min":1.7090000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"max":{"1min":3.5089999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":2.6920000000000002},{"interface":"front","average":{"1min":3.2919999999999998,"5min":3.3889999999999998,"15min":3.383},"min":{"1min":1.845,"5min":1.796,"15min":1.796},"max":{"1min":4.5090000000000003,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":3.2429999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:26:29 2021","interfaces":[{"interface":"back","average":{"1min":3.1429999999999998,"5min":3.1509999999999998,"15min":3.1520000000000001},"min":{"1min":2.1859999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.8580000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":3.1789999999999998},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.923,"15min":2.948},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":3.3460000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":3.0390000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6536,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738616,"statfs":{"total":95995035648,"available":95988342784,"internally_reserved":0,"allocated":917504,"data_stored":242742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.5780000000000001,"15min":1.452},"min":{"1min":0.879,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.3679999999999999,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":2.016},{"interface":"front","average":{"1min":1.738,"5min":1.7390000000000001,"15min":1.677},"min":{"1min":0.92800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.5619999999999998,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":1.8819999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":1.929,"15min":1.7949999999999999},"min":{"1min":1.2789999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.8980000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":2.7360000000000002},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.827,"15min":1.835},"min":{"1min":0.97999999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":2.427}]},{"osd":2,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":1.98,"5min":2.0179999999999998,"15min":2.0390000000000001},"min":{"1min":1.1830000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.9410000000000001},{"interface":"front","average":{"1min":2.2240000000000002,"5min":2.2130000000000001,"15min":2.129},"min":{"1min":1.252,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1600000000000001,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":2.5139999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:27:00 2021","interfaces":[{"interface":"back","average":{"1min":2.6869999999999998,"5min":2.4790000000000001,"15min":2.3610000000000002},"min":{"1min":1.8440000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":2.7909999999999999},{"interface":"front","average":{"1min":2.738,"5min":2.657,"15min":2.5299999999999998},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":4.3029999999999999,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":3}]},{"osd":5,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":2.8799999999999999,"15min":2.8490000000000002},"min":{"1min":1.9810000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"max":{"1min":3.9140000000000001,"5min":4.8410000000000002,"15min":4.8410000000000002},"last":3.3879999999999999},{"interface":"front","average":{"1min":2.6619999999999999,"5min":2.6970000000000001,"15min":2.6749999999999998},"min":{"1min":1.946,"5min":1.5580000000000001,"15min":1.5580000000000001},"max":{"1min":3.4239999999999999,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":3.4590000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:56 2021","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":2.8780000000000001,"15min":2.8650000000000002},"min":{"1min":2.0649999999999999,"5min":1.784,"15min":1.784},"max":{"1min":3.6970000000000001,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":3.1339999999999999},{"interface":"front","average":{"1min":3.0539999999999998,"5min":3.1520000000000001,"15min":3.1240000000000001},"min":{"1min":2.0670000000000002,"5min":1.5069999999999999,"15min":1.5069999999999999},"max":{"1min":3.9500000000000002,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":3.6680000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:26:24 2021","interfaces":[{"interface":"back","average":{"1min":3.073,"5min":3.177,"15min":3.1949999999999998},"min":{"1min":1.885,"5min":1.885,"15min":1.885},"max":{"1min":3.964,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":3.343},{"interface":"front","average":{"1min":3.3290000000000002,"5min":3.4609999999999999,"15min":3.4830000000000001},"min":{"1min":2.202,"5min":1.9330000000000001,"15min":1.9330000000000001},"max":{"1min":4.3550000000000004,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.8570000000000002}]}]},{"osd":4,"up_from":31,"seq":133143986231,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6420,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738732,"statfs":{"total":95995035648,"available":95988461568,"internally_reserved":0,"allocated":864256,"data_stored":240429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":1.8580000000000001,"15min":1.669},"min":{"1min":1.619,"5min":1.204,"15min":1.204},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":1.462},{"interface":"front","average":{"1min":1.8620000000000001,"5min":1.7190000000000001,"15min":1.631},"min":{"1min":1.381,"5min":1.095,"15min":1.095},"max":{"1min":2.4809999999999999,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.365}]},{"osd":1,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.8180000000000001,"15min":1.71},"min":{"1min":1.5489999999999999,"5min":1.143,"15min":1.143},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":2.7069999999999999,"5min":2.339,"15min":2.0590000000000002},"min":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"max":{"1min":4.1589999999999998,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":1.9890000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.8199999999999998,"5min":2.5459999999999998,"15min":2.3479999999999999},"min":{"1min":1.526,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":3.875,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":2.2919999999999998},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.2530000000000001,"15min":2.129},"min":{"1min":1.8120000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":2.0880000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:27:04 2021","interfaces":[{"interface":"back","average":{"1min":2.8029999999999999,"5min":2.4940000000000002,"15min":2.3220000000000001},"min":{"1min":1.883,"5min":1.363,"15min":1.363},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8240000000000001},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.6160000000000001,"15min":2.448},"min":{"1min":2.302,"5min":1.8320000000000001,"15min":1.8320000000000001},"max":{"1min":4.3579999999999997,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.1200000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.8700000000000001,"15min":2.738},"min":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"max":{"1min":4.0369999999999999,"5min":4.569,"15min":4.569},"last":1.1399999999999999},{"interface":"front","average":{"1min":3.2229999999999999,"5min":3.1640000000000001,"15min":3.0510000000000002},"min":{"1min":1.51,"5min":1.51,"15min":1.51},"max":{"1min":4.2380000000000004,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.7150000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:59 2021","interfaces":[{"interface":"back","average":{"1min":3.0369999999999999,"5min":2.952,"15min":2.9580000000000002},"min":{"1min":2.1120000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":2.25},{"interface":"front","average":{"1min":3.121,"5min":3.0310000000000001,"15min":3.0030000000000001},"min":{"1min":2.1200000000000001,"5min":1.754,"15min":1.754},"max":{"1min":3.7949999999999999,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":1.9390000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":3.081,"5min":3.2480000000000002,"15min":3.2759999999999998},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":4.3280000000000003,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":1.7889999999999999},{"interface":"front","average":{"1min":3.5150000000000001,"5min":3.7490000000000001,"15min":3.7879999999999998},"min":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"max":{"1min":4.5030000000000001,"5min":4.806,"15min":4.806},"last":2.1629999999999998}]}]},{"osd":5,"up_from":36,"seq":154618822707,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6200,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738952,"statfs":{"total":95995035648,"available":95988686848,"internally_reserved":0,"allocated":770048,"data_stored":235997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":1.8959999999999999,"15min":1.804},"min":{"1min":1.3460000000000001,"5min":1.143,"15min":1.143},"max":{"1min":2.9399999999999999,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.819},{"interface":"front","average":{"1min":1.9910000000000001,"5min":1.794,"15min":1.6679999999999999},"min":{"1min":1.3240000000000001,"5min":1.056,"15min":1.056},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":2.3929999999999998}]},{"osd":1,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.121,"15min":2.0190000000000001},"min":{"1min":1.474,"5min":1.246,"15min":1.246},"max":{"1min":3.4569999999999999,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":1.177},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.2810000000000001,"15min":2.2269999999999999},"min":{"1min":1.8480000000000001,"5min":1.399,"15min":1.399},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":2.0230000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":2.0920000000000001,"15min":2.0409999999999999},"min":{"1min":1.526,"5min":1.365,"15min":1.365},"max":{"1min":3.9940000000000002,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":1.341},{"interface":"front","average":{"1min":2.7930000000000001,"5min":2.5329999999999999,"15min":2.3940000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":3.6120000000000001,"5min":4.3440000000000003,"15min":4.3440000000000003},"last":2.4950000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":2.6629999999999998,"5min":2.4860000000000002,"15min":2.379},"min":{"1min":1.581,"5min":1.581,"15min":1.581},"max":{"1min":4.4020000000000001,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":2.169},{"interface":"front","average":{"1min":3.141,"5min":2.8540000000000001,"15min":2.722},"min":{"1min":2.3450000000000002,"5min":1.6639999999999999,"15min":1.6639999999999999},"max":{"1min":3.9020000000000001,"5min":4.5110000000000001,"15min":4.5110000000000001},"last":2.831}]},{"osd":4,"last update":"Wed Jan 27 09:26:33 2021","interfaces":[{"interface":"back","average":{"1min":3,"5min":2.589,"15min":2.4910000000000001},"min":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":3.1739999999999999},{"interface":"front","average":{"1min":3.149,"5min":2.7309999999999999,"15min":2.5289999999999999},"min":{"1min":1.984,"5min":1.395,"15min":1.395},"max":{"1min":5.8769999999999998,"5min":5.8769999999999998,"15min":5.8769999999999998},"last":2.6000000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:26:57 2021","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":3.0569999999999999,"15min":3.0110000000000001},"min":{"1min":2.2909999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"max":{"1min":5.3099999999999996,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":2.7639999999999998},{"interface":"front","average":{"1min":3.573,"5min":3.2290000000000001,"15min":3.1659999999999999},"min":{"1min":2.6349999999999998,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":2.9820000000000002}]},{"osd":7,"last update":"Wed Jan 27 09:26:27 2021","interfaces":[{"interface":"back","average":{"1min":3.5920000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.4220000000000002,"5min":1.3,"15min":1.3},"max":{"1min":6.1479999999999997,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":3.3879999999999999},{"interface":"front","average":{"1min":3.4510000000000001,"5min":3.4380000000000002,"15min":3.4359999999999999},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.3280000000000003,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":3.2589999999999999}]}]}]}} 2021-01-27T09:27:26.419 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-01-27T09:27:26.419 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-27T09:27:26.419 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-01-27T09:27:26.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 78337516-6080-11eb-8f9a-001a4aab830c -- ceph health --format=json 2021-01-27T09:27:26.576 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/78337516-6080-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T09:27:26.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:26 smithi047 bash[9721]: audit 2021-01-27T09:27:25.710383+0000 mgr.y (mgr.14138) 435 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:26.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:26 smithi103 bash[9772]: audit 2021-01-27T09:27:25.710383+0000 mgr.y (mgr.14138) 435 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:26.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:26 smithi103 bash[13570]: audit 2021-01-27T09:27:25.710383+0000 mgr.y (mgr.14138) 435 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T09:27:27.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:27 smithi047 bash[9721]: cluster 2021-01-27T09:27:26.297717+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:27.827 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:27 smithi103 bash[13570]: cluster 2021-01-27T09:27:26.297717+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:27.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:27 smithi103 bash[9772]: cluster 2021-01-27T09:27:26.297717+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:29.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- 172.21.15.103:0/1385665315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f5a40 msgr2=0x7ffb9c0f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:29.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- 172.21.15.103:0/1385665315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f5a40 0x7ffb9c0f5ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ffb8c004d70 tx=0x7ffb8c009b30).stop 2021-01-27T09:27:29.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- 172.21.15.103:0/1385665315 shutdown_connections 2021-01-27T09:27:29.413 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- 172.21.15.103:0/1385665315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c0fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.414 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- 172.21.15.103:0/1385665315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c0f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.414 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- 172.21.15.103:0/1385665315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f5a40 0x7ffb9c0f5ea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.414 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- 172.21.15.103:0/1385665315 >> 172.21.15.103:0/1385665315 conn(0x7ffb9c0effa0 msgr2=0x7ffb9c0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:29.414 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- 172.21.15.103:0/1385665315 shutdown_connections 2021-01-27T09:27:29.415 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- 172.21.15.103:0/1385665315 wait complete. 2021-01-27T09:27:29.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 Processor -- start 2021-01-27T09:27:29.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- start start 2021-01-27T09:27:29.416 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:29.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:29.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c105c80 0x7ffb9c106100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:29.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c1065f0 con 0x7ffb9c105c80 2021-01-27T09:27:29.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c106760 con 0x7ffb9c0f6390 2021-01-27T09:27:29.417 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba33a3700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c106920 con 0x7ffb9c0f47a0 2021-01-27T09:27:29.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba23a1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:29.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:29.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba23a1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:33204/0 (socket says 172.21.15.103:33204) 2021-01-27T09:27:29.418 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba23a1700 1 -- 172.21.15.103:0/3991967420 learned_addr learned my addr 172.21.15.103:0/3991967420 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:27:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba2ba2700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c105c80 0x7ffb9c106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 -- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 msgr2=0x7ffb9c1048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.419 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 -- 172.21.15.103:0/3991967420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c105c80 msgr2=0x7ffb9c106100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c105c80 0x7ffb9c106100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 -- 172.21.15.103:0/3991967420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c106ae0 con 0x7ffb9c0f6390 2021-01-27T09:27:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba23a1700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:27:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffba1ba0700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c104d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ffb8c008000 tx=0x7ffb8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:29.420 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.409+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c019070 con 0x7ffb9c0f6390 2021-01-27T09:27:29.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ffb8c00b860 con 0x7ffb9c0f6390 2021-01-27T09:27:29.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c10cf30 con 0x7ffb9c0f6390 2021-01-27T09:27:29.421 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00e040 con 0x7ffb9c0f6390 2021-01-27T09:27:29.422 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c05ea60 con 0x7ffb9c0f6390 2021-01-27T09:27:29.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c0f3b90 con 0x7ffb9c0f6390 2021-01-27T09:27:29.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7ffb8c024060 con 0x7ffb9c0f6390 2021-01-27T09:27:29.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffb92ffd700 1 --2- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 0x7ffb88060340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:27:29.423 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7ffb8c076550 con 0x7ffb9c0f6390 2021-01-27T09:27:29.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.413+0000 7ffba23a1700 1 --2- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 0x7ffb88060340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:27:29.424 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.417+0000 7ffba23a1700 1 --2- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 0x7ffb88060340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ffb98009fd0 tx=0x7ffb98004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:27:29.425 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.421+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ffb8c049230 con 0x7ffb9c0f6390 2021-01-27T09:27:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.645+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb9c0ff460 con 0x7ffb9c0f6390 2021-01-27T09:27:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.645+0000 7ffb92ffd700 1 -- 172.21.15.103:0/3991967420 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7ffb8c04c850 con 0x7ffb9c0f6390 2021-01-27T09:27:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 msgr2=0x7ffb88060340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 0x7ffb88060340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7ffb98009fd0 tx=0x7ffb98004d10).stop 2021-01-27T09:27:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 msgr2=0x7ffb9c104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:27:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c104d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ffb8c008000 tx=0x7ffb8c009b30).stop 2021-01-27T09:27:29.653 INFO:teuthology.orchestra.run.smithi103.stdout: 2021-01-27T09:27:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 shutdown_connections 2021-01-27T09:27:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> v2:172.21.15.103:6800/3303543367 conn(0x7ffb8805de80 0x7ffb88060340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb9c105c80 0x7ffb9c106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb9c0f47a0 0x7ffb9c1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 --2- 172.21.15.103:0/3991967420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0f6390 0x7ffb9c104d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:27:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 >> 172.21.15.103:0/3991967420 conn(0x7ffb9c0effa0 msgr2=0x7ffb9c0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:27:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 shutdown_connections 2021-01-27T09:27:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2021-01-27T09:27:29.649+0000 7ffba33a3700 1 -- 172.21.15.103:0/3991967420 wait complete. 2021-01-27T09:27:29.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:29 smithi047 bash[9721]: cluster 2021-01-27T09:27:28.298864+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:29 smithi103 bash[13570]: cluster 2021-01-27T09:27:28.298864+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:29.860 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:29 smithi103 bash[9772]: cluster 2021-01-27T09:27:28.298864+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:30.424 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-27T09:27:30.425 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-01-27T09:27:30.425 INFO:tasks.cephadm:Setup complete, yielding 2021-01-27T09:27:30.425 INFO:teuthology.run_tasks:Running task workunit... 2021-01-27T09:27:30.441 INFO:tasks.workunit:Pulling workunits from ref 507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:27:30.443 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-27T09:27:30.443 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-27T09:27:30.451 INFO:teuthology.orchestra.run.smithi103.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-27T09:27:30.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:27:30.452 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-01-27T09:27:30.500 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-01-27T09:27:30.501 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-01-27T09:27:30.512 INFO:tasks.workunit:timeout=3h 2021-01-27T09:27:30.512 INFO:tasks.workunit:cleanup=True 2021-01-27T09:27:30.513 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 507028cb839c25d6666833702df6325fd8569096 2021-01-27T09:27:30.521 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-27T09:27:30.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:30 smithi047 bash[9721]: audit 2021-01-27T09:27:29.648315+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? 172.21.15.103:0/3991967420' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:27:30.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:30 smithi103 bash[9772]: audit 2021-01-27T09:27:29.648315+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? 172.21.15.103:0/3991967420' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:27:30.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:30 smithi103 bash[13570]: audit 2021-01-27T09:27:29.648315+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? 172.21.15.103:0/3991967420' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T09:27:31.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:31 smithi047 bash[9721]: cluster 2021-01-27T09:27:30.300311+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:31.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:31 smithi103 bash[9772]: cluster 2021-01-27T09:27:30.300311+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:31.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:31 smithi103 bash[13570]: cluster 2021-01-27T09:27:30.300311+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:33.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:33 smithi047 bash[9721]: cluster 2021-01-27T09:27:32.301197+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:33.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:33 smithi103 bash[13570]: cluster 2021-01-27T09:27:32.301197+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:33.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:33 smithi103 bash[9772]: cluster 2021-01-27T09:27:32.301197+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:34.305 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:34.396 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:34 smithi103 bash[10018]: debug 2021-01-27T09:27:34.026+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:34.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:34 smithi047 bash[9721]: audit 2021-01-27T09:27:34.027683+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:34.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:34 smithi103 bash[9772]: audit 2021-01-27T09:27:34.027683+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:34.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:34 smithi103 bash[13570]: audit 2021-01-27T09:27:34.027683+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:35.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:35 smithi047 bash[9721]: cluster 2021-01-27T09:27:34.302336+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:35.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:35 smithi103 bash[13570]: cluster 2021-01-27T09:27:34.302336+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:35.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:35 smithi103 bash[9772]: cluster 2021-01-27T09:27:34.302336+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:37.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:37 smithi047 bash[9721]: cluster 2021-01-27T09:27:36.303478+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:37.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:37 smithi103 bash[9772]: cluster 2021-01-27T09:27:36.303478+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:37.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:37 smithi103 bash[13570]: cluster 2021-01-27T09:27:36.303478+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:39.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:39 smithi047 bash[9721]: cluster 2021-01-27T09:27:38.304394+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:39 smithi103 bash[9772]: cluster 2021-01-27T09:27:38.304394+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:39.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:39 smithi103 bash[13570]: cluster 2021-01-27T09:27:38.304394+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:41.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:41 smithi047 bash[9721]: cluster 2021-01-27T09:27:40.305747+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:41.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:41 smithi103 bash[13570]: cluster 2021-01-27T09:27:40.305747+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:41.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:41 smithi103 bash[9772]: cluster 2021-01-27T09:27:40.305747+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:43.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:43 smithi047 bash[9721]: cluster 2021-01-27T09:27:42.306770+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:43 smithi103 bash[13570]: cluster 2021-01-27T09:27:42.306770+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:43 smithi103 bash[9772]: cluster 2021-01-27T09:27:42.306770+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:44.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:44.396 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:44 smithi103 bash[10018]: debug 2021-01-27T09:27:44.038+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:44.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:44 smithi047 bash[9721]: audit 2021-01-27T09:27:44.039038+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:44.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:44 smithi103 bash[13570]: audit 2021-01-27T09:27:44.039038+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:44 smithi103 bash[9772]: audit 2021-01-27T09:27:44.039038+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:45.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:45 smithi047 bash[9721]: cluster 2021-01-27T09:27:44.307970+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:45.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:45 smithi103 bash[9772]: cluster 2021-01-27T09:27:44.307970+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:45.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:45 smithi103 bash[13570]: cluster 2021-01-27T09:27:44.307970+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:47.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:47 smithi103 bash[9772]: cluster 2021-01-27T09:27:46.309275+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:47.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:47 smithi103 bash[13570]: cluster 2021-01-27T09:27:46.309275+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:48.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:47 smithi047 bash[9721]: cluster 2021-01-27T09:27:46.309275+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:49.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:49 smithi103 bash[9772]: cluster 2021-01-27T09:27:48.310276+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:49.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:49 smithi103 bash[13570]: cluster 2021-01-27T09:27:48.310276+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:50.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:49 smithi047 bash[9721]: cluster 2021-01-27T09:27:48.310276+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:51.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:51 smithi103 bash[9772]: cluster 2021-01-27T09:27:50.311941+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:51.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:51 smithi103 bash[13570]: cluster 2021-01-27T09:27:50.311941+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:52.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:51 smithi047 bash[9721]: cluster 2021-01-27T09:27:50.311941+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:53 smithi103 bash[9772]: cluster 2021-01-27T09:27:52.312932+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:53 smithi103 bash[13570]: cluster 2021-01-27T09:27:52.312932+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:54.050 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:53 smithi047 bash[9721]: cluster 2021-01-27T09:27:52.312932+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:54.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:27:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:27:54.395 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:27:54 smithi103 bash[10018]: debug 2021-01-27T09:27:54.042+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:27:54.841 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:54 smithi047 bash[9721]: audit 2021-01-27T09:27:54.048868+0000 mgr.y (mgr.14138) 452 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:54.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:54 smithi103 bash[9772]: audit 2021-01-27T09:27:54.048868+0000 mgr.y (mgr.14138) 452 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:54.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:54 smithi103 bash[13570]: audit 2021-01-27T09:27:54.048868+0000 mgr.y (mgr.14138) 452 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:27:55.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:55 smithi103 bash[13570]: cluster 2021-01-27T09:27:54.314416+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:55.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:55 smithi103 bash[9772]: cluster 2021-01-27T09:27:54.314416+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:56.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:55 smithi047 bash[9721]: cluster 2021-01-27T09:27:54.314416+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:57.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:57 smithi103 bash[9772]: cluster 2021-01-27T09:27:56.315604+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:57 smithi103 bash[13570]: cluster 2021-01-27T09:27:56.315604+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:58.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:57 smithi047 bash[9721]: cluster 2021-01-27T09:27:56.315604+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:27:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:58 smithi103 bash[9772]: audit 2021-01-27T09:27:58.344687+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:27:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:58 smithi103 bash[9772]: audit 2021-01-27T09:27:58.347117+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:27:58.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:58 smithi103 bash[13570]: audit 2021-01-27T09:27:58.344687+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:27:58.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:58 smithi103 bash[13570]: audit 2021-01-27T09:27:58.347117+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:27:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:58 smithi047 bash[9721]: audit 2021-01-27T09:27:58.344687+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:27:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:58 smithi047 bash[9721]: audit 2021-01-27T09:27:58.347117+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:27:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:27:59 smithi103 bash[9772]: cluster 2021-01-27T09:27:58.316208+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:27:59.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:27:59 smithi103 bash[13570]: cluster 2021-01-27T09:27:58.316208+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:27:59 smithi047 bash[9721]: cluster 2021-01-27T09:27:58.316208+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:01.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:01 smithi103 bash[9772]: cluster 2021-01-27T09:28:00.317534+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:01.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:01 smithi103 bash[13570]: cluster 2021-01-27T09:28:00.317534+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:01 smithi047 bash[9721]: cluster 2021-01-27T09:28:00.317534+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:03.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:03 smithi103 bash[9772]: cluster 2021-01-27T09:28:02.318227+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:03.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:03 smithi103 bash[13570]: cluster 2021-01-27T09:28:02.318227+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:04.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:03 smithi047 bash[9721]: cluster 2021-01-27T09:28:02.318227+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:04.395 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:04 smithi103 bash[10018]: debug 2021-01-27T09:28:04.055+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:04.553 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:04.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:04 smithi103 bash[13570]: audit 2021-01-27T09:28:04.056599+0000 mgr.y (mgr.14138) 458 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:04.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:04 smithi103 bash[9772]: audit 2021-01-27T09:28:04.056599+0000 mgr.y (mgr.14138) 458 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:05.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:04 smithi047 bash[9721]: audit 2021-01-27T09:28:04.056599+0000 mgr.y (mgr.14138) 458 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:05.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:05 smithi103 bash[13570]: cluster 2021-01-27T09:28:04.319278+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:05 smithi103 bash[9772]: cluster 2021-01-27T09:28:04.319278+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:05 smithi047 bash[9721]: cluster 2021-01-27T09:28:04.319278+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:07.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:07 smithi103 bash[9772]: cluster 2021-01-27T09:28:06.319974+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:07.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:07 smithi103 bash[13570]: cluster 2021-01-27T09:28:06.319974+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:08.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:07 smithi047 bash[9721]: cluster 2021-01-27T09:28:06.319974+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:10.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:09 smithi047 bash[9721]: cluster 2021-01-27T09:28:08.320803+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:10.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:09 smithi103 bash[13570]: cluster 2021-01-27T09:28:08.320803+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:10.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:09 smithi103 bash[9772]: cluster 2021-01-27T09:28:08.320803+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:11.934 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:11 smithi103 bash[9772]: cluster 2021-01-27T09:28:10.321473+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:11.935 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:11 smithi103 bash[13570]: cluster 2021-01-27T09:28:10.321473+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:12.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:11 smithi047 bash[9721]: cluster 2021-01-27T09:28:10.321473+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:14.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:13 smithi047 bash[9721]: cluster 2021-01-27T09:28:12.322051+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:14.064 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:13 smithi103 bash[13570]: cluster 2021-01-27T09:28:12.322051+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:14.065 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:13 smithi103 bash[9772]: cluster 2021-01-27T09:28:12.322051+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:14.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:14 smithi103 bash[10018]: debug 2021-01-27T09:28:14.059+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:14.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:15.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:14 smithi047 bash[9721]: audit 2021-01-27T09:28:14.064450+0000 mgr.y (mgr.14138) 464 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:15.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:14 smithi103 bash[13570]: audit 2021-01-27T09:28:14.064450+0000 mgr.y (mgr.14138) 464 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:15.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:14 smithi103 bash[9772]: audit 2021-01-27T09:28:14.064450+0000 mgr.y (mgr.14138) 464 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:15 smithi047 bash[9721]: cluster 2021-01-27T09:28:14.322698+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-01-27T09:28:16.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:15 smithi103 bash[13570]: cluster 2021-01-27T09:28:14.322698+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-01-27T09:28:16.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:15 smithi103 bash[9772]: cluster 2021-01-27T09:28:14.322698+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-01-27T09:28:18.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:17 smithi047 bash[9721]: cluster 2021-01-27T09:28:16.323961+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:18.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:17 smithi103 bash[13570]: cluster 2021-01-27T09:28:16.323961+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:18.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:17 smithi103 bash[9772]: cluster 2021-01-27T09:28:16.323961+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:20.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:19 smithi047 bash[9721]: cluster 2021-01-27T09:28:18.324561+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:20.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:19 smithi103 bash[13570]: cluster 2021-01-27T09:28:18.324561+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:20.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:19 smithi103 bash[9772]: cluster 2021-01-27T09:28:18.324561+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:22.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:21 smithi047 bash[9721]: cluster 2021-01-27T09:28:20.325815+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:22.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:21 smithi103 bash[13570]: cluster 2021-01-27T09:28:20.325815+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:22.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:21 smithi103 bash[9772]: cluster 2021-01-27T09:28:20.325815+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:24.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:23 smithi047 bash[9721]: cluster 2021-01-27T09:28:22.326485+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:24.072 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:23 smithi103 bash[13570]: cluster 2021-01-27T09:28:22.326485+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:24.072 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:23 smithi103 bash[9772]: cluster 2021-01-27T09:28:22.326485+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:24.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:24 smithi103 bash[10018]: debug 2021-01-27T09:28:24.067+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:24.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:24 smithi047 bash[9721]: audit 2021-01-27T09:28:24.072304+0000 mgr.y (mgr.14138) 470 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:25.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:24 smithi103 bash[9772]: audit 2021-01-27T09:28:24.072304+0000 mgr.y (mgr.14138) 470 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:25.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:24 smithi103 bash[13570]: audit 2021-01-27T09:28:24.072304+0000 mgr.y (mgr.14138) 470 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:26.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:25 smithi047 bash[9721]: cluster 2021-01-27T09:28:24.327831+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:26.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:25 smithi103 bash[9772]: cluster 2021-01-27T09:28:24.327831+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:26.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:25 smithi103 bash[13570]: cluster 2021-01-27T09:28:24.327831+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:28.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:27 smithi047 bash[9721]: cluster 2021-01-27T09:28:26.328446+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:28.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:27 smithi103 bash[13570]: cluster 2021-01-27T09:28:26.328446+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:28.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:27 smithi103 bash[9772]: cluster 2021-01-27T09:28:26.328446+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:30.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:29 smithi047 bash[9721]: cluster 2021-01-27T09:28:28.329377+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:30.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:29 smithi103 bash[13570]: cluster 2021-01-27T09:28:28.329377+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:30.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:29 smithi103 bash[9772]: cluster 2021-01-27T09:28:28.329377+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:31.843 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '507028cb839c25d6666833702df6325fd8569096'. 2021-01-27T09:28:31.843 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.843 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-27T09:28:31.843 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-27T09:28:31.844 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2021-01-27T09:28:31.844 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.844 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-27T09:28:31.844 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-27T09:28:31.845 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.845 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2021-01-27T09:28:31.845 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.845 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2021-01-27T09:28:31.845 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.846 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2021-01-27T09:28:31.846 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.846 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-27T09:28:31.846 INFO:tasks.workunit.client.0.smithi103.stderr: 2021-01-27T09:28:31.846 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 507028cb83 Merge branch 'wip-zabbix-ann' of https://github.com/tchaikov/ceph into wip-kefu-testing-2021-01-27-1353 2021-01-27T09:28:31.848 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-27T09:28:31.901 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-27T09:28:31.905 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T09:28:31.905 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-27T09:28:32.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:31 smithi047 bash[9721]: cluster 2021-01-27T09:28:30.330531+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:32.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:31 smithi103 bash[9772]: cluster 2021-01-27T09:28:30.330531+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:32.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:31 smithi103 bash[13570]: cluster 2021-01-27T09:28:30.330531+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:32.670 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-27T09:28:32.789 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-27T09:28:32.846 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T09:28:32.848 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T09:28:32.848 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-27T09:28:32.908 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T09:28:32.912 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2021-01-27T09:28:32.912 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-27T09:28:32.918 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2021-01-27T09:28:32.919 INFO:tasks.workunit:Running workunit rados/test.sh... 2021-01-27T09:28:32.919 DEBUG:teuthology.orchestra.run.smithi103:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=507028cb839c25d6666833702df6325fd8569096 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2021-01-27T09:28:32.936 INFO:tasks.workunit.client.0.smithi103.stderr:+ parallel=1 2021-01-27T09:28:32.937 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' '' = --serial ']' 2021-01-27T09:28:32.938 INFO:tasks.workunit.client.0.smithi103.stderr:+ color= 2021-01-27T09:28:32.938 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -t 1 ']' 2021-01-27T09:28:32.938 INFO:tasks.workunit.client.0.smithi103.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2021-01-27T09:28:32.938 INFO:tasks.workunit.client.0.smithi103.stderr:+ declare -A pids 2021-01-27T09:28:32.938 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.939 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.939 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_aio 2021-01-27T09:28:32.939 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_aio' 2021-01-27T09:28:32.939 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_aio 2021-01-27T09:28:32.941 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.941 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_aio 2021-01-27T09:28:32.941 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32159 2021-01-27T09:28:32.941 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_aio on pid 32159' 2021-01-27T09:28:32.942 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32159 2021-01-27T09:28:32.942 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2021-01-27T09:28:32.942 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.942 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.943 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_aio_pp 2021-01-27T09:28:32.943 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_aio_pp' 2021-01-27T09:28:32.943 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_aio_pp 2021-01-27T09:28:32.943 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.943 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.944 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.944 INFO:tasks.workunit.client.0.smithi103.stdout:test api_aio on pid 32159 2021-01-27T09:28:32.945 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.946 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.946 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_aio 2021-01-27T09:28:32.946 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_aio.log 2021-01-27T09:28:32.946 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_aio: /' 2021-01-27T09:28:32.946 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_aio_pp 2021-01-27T09:28:32.947 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32167 2021-01-27T09:28:32.947 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_aio_pp on pid 32167' 2021-01-27T09:28:32.947 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32167 2021-01-27T09:28:32.947 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.947 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.948 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2021-01-27T09:28:32.948 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_io 2021-01-27T09:28:32.949 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_io' 2021-01-27T09:28:32.949 INFO:tasks.workunit.client.0.smithi103.stdout:test api_aio_pp on pid 32167 2021-01-27T09:28:32.950 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_io 2021-01-27T09:28:32.951 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.951 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.951 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.952 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.952 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.952 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_aio_pp 2021-01-27T09:28:32.952 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_aio_pp: /' 2021-01-27T09:28:32.953 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_aio_pp.log 2021-01-27T09:28:32.953 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_io 2021-01-27T09:28:32.953 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32175 2021-01-27T09:28:32.953 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_io on pid 32175' 2021-01-27T09:28:32.953 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32175 2021-01-27T09:28:32.954 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.954 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.954 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2021-01-27T09:28:32.954 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_io_pp 2021-01-27T09:28:32.954 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_io_pp' 2021-01-27T09:28:32.955 INFO:tasks.workunit.client.0.smithi103.stdout:test api_io on pid 32175 2021-01-27T09:28:32.956 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.956 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_io_pp 2021-01-27T09:28:32.957 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.957 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.957 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.957 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.957 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_io.log 2021-01-27T09:28:32.958 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_io: /' 2021-01-27T09:28:32.958 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_io 2021-01-27T09:28:32.958 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_io_pp 2021-01-27T09:28:32.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32183 2021-01-27T09:28:32.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_io_pp on pid 32183' 2021-01-27T09:28:32.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32183 2021-01-27T09:28:32.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.960 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2021-01-27T09:28:32.960 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_asio 2021-01-27T09:28:32.960 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_asio' 2021-01-27T09:28:32.960 INFO:tasks.workunit.client.0.smithi103.stdout:test api_io_pp on pid 32183 2021-01-27T09:28:32.962 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.962 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.962 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.962 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.963 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_io_pp 2021-01-27T09:28:32.963 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_asio 2021-01-27T09:28:32.963 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_io_pp.log 2021-01-27T09:28:32.963 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_io_pp: /' 2021-01-27T09:28:32.964 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.964 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_asio 2021-01-27T09:28:32.964 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32191 2021-01-27T09:28:32.964 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_asio on pid 32191' 2021-01-27T09:28:32.964 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32191 2021-01-27T09:28:32.965 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.965 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.965 INFO:tasks.workunit.client.0.smithi103.stdout:test api_asio on pid 32191 2021-01-27T09:28:32.967 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2021-01-27T09:28:32.967 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_list 2021-01-27T09:28:32.967 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_list' 2021-01-27T09:28:32.968 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_list 2021-01-27T09:28:32.968 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.968 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.968 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.969 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.969 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.969 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_asio 2021-01-27T09:28:32.971 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_asio.log 2021-01-27T09:28:32.972 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_asio: /' 2021-01-27T09:28:32.972 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_list 2021-01-27T09:28:32.972 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32199 2021-01-27T09:28:32.972 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_list on pid 32199' 2021-01-27T09:28:32.973 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32199 2021-01-27T09:28:32.973 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.973 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.973 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2021-01-27T09:28:32.973 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_lock 2021-01-27T09:28:32.974 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_lock' 2021-01-27T09:28:32.974 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.974 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.974 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.974 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.975 INFO:tasks.workunit.client.0.smithi103.stdout:test api_list on pid 32199 2021-01-27T09:28:32.977 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.977 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_list: /' 2021-01-27T09:28:32.978 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_list 2021-01-27T09:28:32.978 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_list.log 2021-01-27T09:28:32.978 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_lock 2021-01-27T09:28:32.978 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_lock 2021-01-27T09:28:32.979 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32207 2021-01-27T09:28:32.979 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_lock on pid 32207' 2021-01-27T09:28:32.979 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32207 2021-01-27T09:28:32.979 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.980 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.980 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2021-01-27T09:28:32.980 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_lock_pp 2021-01-27T09:28:32.980 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_lock_pp' 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_lock_pp 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.981 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.982 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_lock.log 2021-01-27T09:28:32.982 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_lock: /' 2021-01-27T09:28:32.982 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_lock 2021-01-27T09:28:32.982 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_lock_pp 2021-01-27T09:28:32.982 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32215 2021-01-27T09:28:32.983 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_lock_pp on pid 32215' 2021-01-27T09:28:32.983 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32215 2021-01-27T09:28:32.983 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.983 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.983 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2021-01-27T09:28:32.984 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.984 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.984 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.984 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.984 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_lock_pp 2021-01-27T09:28:32.985 INFO:tasks.workunit.client.0.smithi103.stdout:test api_lock on pid 32207 2021-01-27T09:28:32.985 INFO:tasks.workunit.client.0.smithi103.stdout:test api_lock_pp on pid 32215 2021-01-27T09:28:32.986 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_lock_pp: /' 2021-01-27T09:28:32.986 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_misc 2021-01-27T09:28:32.986 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_misc' 2021-01-27T09:28:32.987 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_lock_pp.log 2021-01-27T09:28:32.988 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_misc 2021-01-27T09:28:32.988 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.991 INFO:tasks.workunit.client.0.smithi103.stdout:test api_misc on pid 32231 2021-01-27T09:28:32.991 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_misc 2021-01-27T09:28:32.991 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32231 2021-01-27T09:28:32.991 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_misc on pid 32231' 2021-01-27T09:28:32.992 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32231 2021-01-27T09:28:32.992 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:32.992 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:32.992 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2021-01-27T09:28:32.993 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_misc_pp 2021-01-27T09:28:32.993 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_misc_pp' 2021-01-27T09:28:32.994 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:32.994 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.994 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:32.994 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:32.995 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_misc.log 2021-01-27T09:28:32.996 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_misc_pp 2021-01-27T09:28:32.996 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:32.996 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_misc 2021-01-27T09:28:32.996 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_misc: /' 2021-01-27T09:28:32.999 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_misc_pp 2021-01-27T09:28:32.999 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32280 2021-01-27T09:28:33.000 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_misc_pp on pid 32280' 2021-01-27T09:28:33.000 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32280 2021-01-27T09:28:33.000 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.001 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.001 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2021-01-27T09:28:33.001 INFO:tasks.workunit.client.0.smithi103.stdout:test api_misc_pp on pid 32280 2021-01-27T09:28:33.002 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.002 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.002 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.002 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.003 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_misc_pp: /' 2021-01-27T09:28:33.003 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_misc_pp.log 2021-01-27T09:28:33.003 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_misc_pp 2021-01-27T09:28:33.009 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_tier_pp 2021-01-27T09:28:33.010 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_tier_pp' 2021-01-27T09:28:33.011 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.014 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_tier_pp 2021-01-27T09:28:33.015 INFO:tasks.workunit.client.0.smithi103.stdout:test api_tier_pp on pid 32328 2021-01-27T09:28:33.015 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_tier_pp 2021-01-27T09:28:33.016 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32328 2021-01-27T09:28:33.016 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_tier_pp on pid 32328' 2021-01-27T09:28:33.016 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32328 2021-01-27T09:28:33.016 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.017 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.017 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2021-01-27T09:28:33.017 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_pool 2021-01-27T09:28:33.018 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_pool' 2021-01-27T09:28:33.018 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.018 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.018 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.019 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.019 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_tier_pp: /' 2021-01-27T09:28:33.019 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.020 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_tier_pp.log 2021-01-27T09:28:33.020 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_tier_pp 2021-01-27T09:28:33.021 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_pool 2021-01-27T09:28:33.023 INFO:tasks.workunit.client.0.smithi103.stdout:test api_pool on pid 32371 2021-01-27T09:28:33.023 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_pool 2021-01-27T09:28:33.024 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32371 2021-01-27T09:28:33.024 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_pool on pid 32371' 2021-01-27T09:28:33.024 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32371 2021-01-27T09:28:33.024 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.024 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.025 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_snapshots 2021-01-27T09:28:33.026 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2021-01-27T09:28:33.026 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_snapshots' 2021-01-27T09:28:33.026 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.026 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.027 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.027 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.027 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_pool.log 2021-01-27T09:28:33.027 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_pool: /' 2021-01-27T09:28:33.027 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_pool 2021-01-27T09:28:33.030 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.033 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_snapshots 2021-01-27T09:28:33.033 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_snapshots 2021-01-27T09:28:33.034 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32384 2021-01-27T09:28:33.034 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_snapshots on pid 32384' 2021-01-27T09:28:33.035 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32384 2021-01-27T09:28:33.035 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.035 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.035 INFO:tasks.workunit.client.0.smithi103.stdout:test api_snapshots on pid 32384 2021-01-27T09:28:33.036 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2021-01-27T09:28:33.036 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_snapshots_pp 2021-01-27T09:28:33.037 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_snapshots_pp' 2021-01-27T09:28:33.038 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.038 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.038 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.038 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.039 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_snapshots_pp 2021-01-27T09:28:33.039 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.039 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_snapshots 2021-01-27T09:28:33.040 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_snapshots.log 2021-01-27T09:28:33.040 INFO:tasks.workunit.client.0.smithi103.stdout:test api_snapshots_pp on pid 32392 2021-01-27T09:28:33.041 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_snapshots_pp 2021-01-27T09:28:33.041 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32392 2021-01-27T09:28:33.041 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_snapshots_pp on pid 32392' 2021-01-27T09:28:33.041 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32392 2021-01-27T09:28:33.041 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.042 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.043 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2021-01-27T09:28:33.043 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_stat 2021-01-27T09:28:33.043 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_stat' 2021-01-27T09:28:33.043 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.044 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.044 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.044 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.044 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_stat 2021-01-27T09:28:33.044 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_snapshots_pp 2021-01-27T09:28:33.045 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_snapshots_pp: /' 2021-01-27T09:28:33.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2021-01-27T09:28:33.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] Global test environment set-up. 2021-01-27T09:28:33.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2021-01-27T09:28:33.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2021-01-27T09:28:33.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2021-01-27T09:28:33.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-01-27T09:28:33.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2021-01-27T09:28:33.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2021-01-27T09:28:33.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 0 2021-01-27T09:28:33.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.035+0000 7f49cbd683c0 10 monclient: get_monmap_and_config 2021-01-27T09:28:33.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.035+0000 7f49cbd683c0 10 monclient: build_initial_monmap 2021-01-27T09:28:33.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.035+0000 7f49cbd683c0 10 monclient: monmap: 2021-01-27T09:28:33.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: epoch 0 2021-01-27T09:28:33.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: fsid 78337516-6080-11eb-8f9a-001a4aab830c 2021-01-27T09:28:33.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: last_changed 2021-01-27T09:28:33.041604+0000 2021-01-27T09:28:33.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: created 2021-01-27T09:28:33.041604+0000 2021-01-27T09:28:33.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: min_mon_release 0 (unknown) 2021-01-27T09:28:33.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: election_strategy: 1 2021-01-27T09:28:33.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.noname-b 2021-01-27T09:28:33.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.noname-a 2021-01-27T09:28:33.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2: [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] mon.noname-c 2021-01-27T09:28:33.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 Processor -- start 2021-01-27T09:28:33.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- start start 2021-01-27T09:28:33.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-27T09:28:33.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 0x55979673e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x55979673f520 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x55979673e500 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967e3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967d8b30 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967d8b30 2021-01-27T09:28:33.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x55979673f520 2021-01-27T09:28:33.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.055 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.055 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2021-01-27T09:28:33.055 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_snapshots: /' 2021-01-27T09:28:33.056 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_stat 2021-01-27T09:28:33.056 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32427 2021-01-27T09:28:33.056 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_stat on pid 32427' 2021-01-27T09:28:33.056 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32427 2021-01-27T09:28:33.056 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.057 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.057 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2021-01-27T09:28:33.057 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_stat_pp 2021-01-27T09:28:33.057 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_stat_pp' 2021-01-27T09:28:33.057 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_stat_pp 2021-01-27T09:28:33.058 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.058 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.058 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.058 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.059 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.059 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_stat 2021-01-27T09:28:33.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x55979673e500 2021-01-27T09:28:33.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.042674+0000 2021-01-27T09:28:33.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 msgr2=0x55979673e980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 msgr2=0x55979673e010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 0x55979673e010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 msgr2=0x5597967e3940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.039+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967e3940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[2,0,1] 2021-01-27T09:28:33.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x55979673e500 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967d8b30 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 0x5597967dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x55979673f520 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967d8b30 2021-01-27T09:28:33.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening montest api_stat on pid 32427 2021-01-27T09:28:33.064 INFO:tasks.workunit.client.0.smithi103.stdout: connection 2021-01-27T09:28:33.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x55979673f520 2021-01-27T09:28:33.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x55979673e500 2021-01-27T09:28:33.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.047229+0000 2021-01-27T09:28:33.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.066 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.066 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.066 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 msgr2=0x55979673e980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.066 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.066 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 msgr2=0x5597967dcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.067 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55979673f520 0x5597967dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.067 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.067 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.067 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.068 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.068 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[0,1,2] 2021-01-27T09:28:33.068 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.068 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967d8b30 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.068 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.069 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.069 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.069 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x55979673e500 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.069 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.069 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967d8b30 2021-01-27T09:28:33.070 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.070 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.070 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.070 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x55979673e500 2021-01-27T09:28:33.071 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.071 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.047647+0000 2021-01-27T09:28:33.071 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.071 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.071 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.072 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 msgr2=0x55979673e980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.072 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55979673e500 0x55979673e980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.072 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.072 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.072 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:28:33.073 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.073 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.073 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.073 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[0,2,1] 2021-01-27T09:28:33.073 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.074 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967d8b30 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.074 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967db990 0x5597967dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.074 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967db990 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.074 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.074 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.075 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.075 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967d8b30 2021-01-27T09:28:33.075 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.075 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.075 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.076 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.076 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967db990 0x5597967dbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.076 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.076 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967db990 2021-01-27T09:28:33.076 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50588/0 (socket says 172.21.15.103:50588) 2021-01-27T09:28:33.077 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.103:40126/0 (socket says 172.21.15.103:40126) 2021-01-27T09:28:33.077 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 1 -- 172.21.15.103:0/2069309486 learned_addr learned my addr 172.21.15.103:0/2069309486 (peer_addr_for_me v2:172.21.15.103:0/0) 2021-01-27T09:28:33.077 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.077 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.048671+0000 2021-01-27T09:28:33.078 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): get_auth_request con 0x5597967dd050 auth_method 0 2021-01-27T09:28:33.078 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-27T09:28:33.078 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): _init_auth method 2 2021-01-27T09:28:33.078 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 10 monclient(hunting): get_auth_request con 0x5597967d8b30 auth_method 0 2021-01-27T09:28:33.078 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-27T09:28:33.079 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 10 monclient(hunting): _init_auth method 2 2021-01-27T09:28:33.079 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.079 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.079 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.079 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967db990 msgr2=0x5597967dbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.080 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967db990 0x5597967dbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.080 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.080 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.080 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.080 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967d8b30 0x5597967dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.081 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.081 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.081 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[0,2,1] 2021-01-27T09:28:33.081 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.081 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.082 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967d73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.082 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.082 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.082 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.049029+0000 2021-01-27T09:28:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 10 monclient(hunting): get_auth_request con 0x5597967db990 auth_method 0 2021-01-27T09:28:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967db990 0x5597967dbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): get_auth_request con 0x5597967dd050 auth_method 0 2021-01-27T09:28:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-27T09:28:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967d73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 10 monclient(hunting): _init_auth method 2 2021-01-27T09:28:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967d73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967d73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 10 monclient: get_auth_request con 0x5597967d7010 auth_method 0 2021-01-27T09:28:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967d73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8f41700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[2,1,0] 2021-01-27T09:28:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.090 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.090 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.090 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.090 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.090 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.053521+0000 2021-01-27T09:28:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.043+0000 7f49c8740700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c8740700 10 monclient(hunting): get_auth_request con 0x5597967d7010 auth_method 0 2021-01-27T09:28:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c8740700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-27T09:28:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c8740700 10 monclient(hunting): _init_auth method 2 2021-01-27T09:28:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c7f3f700 10 monclient: get_auth_request con 0x5597967dd050 auth_method 0 2021-01-27T09:28:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.047+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-27T09:28:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.102 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.102 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.102 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.102 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.103 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.103 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.103 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.103 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.103 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.054304+0000 2021-01-27T09:28:33.104 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.104 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.104 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.104 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.104 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.105 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.105 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.105 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.105 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.105 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.106 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49c7f3f700 10 monclient: get_auth_request con 0x5597967d7010 auth_method 0 2021-01-27T09:28:33.106 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.106 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.106 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.107 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[2,0,1] 2021-01-27T09:28:33.107 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.107 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.107 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.107 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.108 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.108 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.108 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.108 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.108 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.109 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.109 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.109 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.109 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.109 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.055919+0000 2021-01-27T09:28:33.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050test api_stat_pp on pid 32454 2021-01-27T09:28:33.111 INFO:tasks.workunit.client.0.smithi103.stdout: 0x5597967db2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:28:33.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.051+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-27T09:28:33.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.059613+0000 2021-01-27T09:28:33.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:28:33.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:28:33.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:28:33.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: init 2021-01-27T09:28:33.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: _reopen_session rank -1 2021-01-27T09:28:33.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient: _add_conns ranks=[2,1,0] 2021-01-27T09:28:33.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-c con 0x5597967d7010 addr [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] 2021-01-27T09:28:33.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-a con 0x5597967dd050 addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2021-01-27T09:28:33.119 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:28:33.119 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): picked mon.noname-b con 0x5597967dcb60 addr [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2021-01-27T09:28:33.119 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.119 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668d3f0 con 0x5597967dcb60 2021-01-27T09:28:33.119 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.120 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979668e200 con 0x5597967dd050 2021-01-27T09:28:33.120 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): start opening mon connection 2021-01-27T09:28:33.120 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979665b760 con 0x5597967d7010 2021-01-27T09:28:33.120 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): _renew_subs 2021-01-27T09:28:33.120 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): authenticate will time out at 2021-01-27T09:28:33.060133+0000 2021-01-27T09:28:33.121 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8740700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.121 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-27T09:28:33.121 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 10 monclient(hunting): shutdown 2021-01-27T09:28:33.121 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-27T09:28:33.122 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 msgr2=0x5597967dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.122 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8f41700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.122 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:28:33.122 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.122 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 msgr2=0x5597967db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.123 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.123 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 msgr2=0x5597967d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:28:33.123 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:28:33.123 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8740700 10 monclient: get_auth_request con 0x5597967d7010 auth_method 0 2021-01-27T09:28:33.123 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8f41700 10 monclient: get_auth_request con 0x5597967dcb60 auth_method 0 2021-01-27T09:28:33.124 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8740700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.124 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c7f3f700 10 monclient: get_auth_request con 0x5597967dd050 auth_method 0 2021-01-27T09:28:33.124 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c8f41700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.124 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.055+0000 7f49c7f3f700 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:28:33.124 INFO:tasks.workunit.client.0.smithi103.stdout: test api_watch_notify on pid 32471 2021-01-27T09:28:33.125 INFO:tasks.workunit.client.0.smithi103.stdout:test api_watch_notify_pp on pid 32497 2021-01-27T09:28:33.125 INFO:tasks.workunit.client.0.smithi103.stdout:test api_cmd on pid 32516 2021-01-27T09:28:33.125 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_stat_pp 2021-01-27T09:28:33.125 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32454 2021-01-27T09:28:33.126 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_stat_pp on pid 32454' 2021-01-27T09:28:33.126 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32454 2021-01-27T09:28:33.126 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.126 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2021-01-27T09:28:33.126 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.127 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_stat.log 2021-01-27T09:28:33.127 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_stat: /' 2021-01-27T09:28:33.127 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_watch_notify 2021-01-27T09:28:33.127 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_watch_notify' 2021-01-27T09:28:33.127 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.128 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.128 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.128 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.128 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_stat_pp 2021-01-27T09:28:33.128 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_stat_pp.log 2021-01-27T09:28:33.129 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_stat_pp: /' 2021-01-27T09:28:33.129 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_watch_notify 2021-01-27T09:28:33.129 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.129 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_watch_notify 2021-01-27T09:28:33.129 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32471 2021-01-27T09:28:33.130 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_watch_notify on pid 32471' 2021-01-27T09:28:33.130 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32471 2021-01-27T09:28:33.130 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.130 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.130 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2021-01-27T09:28:33.131 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.131 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.131 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.131 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.131 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_watch_notify.log 2021-01-27T09:28:33.132 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_watch_notify_pp 2021-01-27T09:28:33.132 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_watch_notify 2021-01-27T09:28:33.132 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_watch_notify_pp' 2021-01-27T09:28:33.133 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_watch_notify: /' 2021-01-27T09:28:33.133 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.133 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_watch_notify_pp 2021-01-27T09:28:33.133 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_watch_notify_pp 2021-01-27T09:28:33.133 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32497 2021-01-27T09:28:33.134 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_watch_notify_pp on pid 32497' 2021-01-27T09:28:33.134 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32497 2021-01-27T09:28:33.134 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.134 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.134 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_cmd 2021-01-27T09:28:33.135 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_cmd' 2021-01-27T09:28:33.135 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2021-01-27T09:28:33.135 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.135 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_cmd 2021-01-27T09:28:33.136 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_cmd 2021-01-27T09:28:33.136 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32516 2021-01-27T09:28:33.136 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_cmd on pid 32516' 2021-01-27T09:28:33.136 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32516 2021-01-27T09:28:33.136 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.137 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.137 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.137 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.137 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.137 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.138 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2021-01-27T09:28:33.138 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_watch_notify_pp 2021-01-27T09:28:33.138 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2021-01-27T09:28:33.138 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_cmd_pp 2021-01-27T09:28:33.138 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2021-01-27T09:28:33.139 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_cmd_pp' 2021-01-27T09:28:33.139 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.139 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.139 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.139 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.140 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_cmd 2021-01-27T09:28:33.140 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_cmd: /' 2021-01-27T09:28:33.140 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_cmd_pp 2021-01-27T09:28:33.140 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_cmd.log 2021-01-27T09:28:33.140 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.146 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_cmd_pp 2021-01-27T09:28:33.146 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32575 2021-01-27T09:28:33.146 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_cmd_pp on pid 32575' 2021-01-27T09:28:33.147 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32575 2021-01-27T09:28:33.147 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.147 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.147 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2021-01-27T09:28:33.147 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_service 2021-01-27T09:28:33.148 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_service' 2021-01-27T09:28:33.148 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.148 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.148 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.148 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.149 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_service 2021-01-27T09:28:33.149 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.149 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_cmd_pp: /' 2021-01-27T09:28:33.149 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_service 2021-01-27T09:28:33.150 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32598 2021-01-27T09:28:33.150 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_service on pid 32598' 2021-01-27T09:28:33.150 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32598 2021-01-27T09:28:33.150 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2021-01-27T09:28:33.150 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.151 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.151 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_service_pp 2021-01-27T09:28:33.151 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_service_pp' 2021-01-27T09:28:33.151 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.151 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_service_pp 2021-01-27T09:28:33.152 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_cmd_pp 2021-01-27T09:28:33.152 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.152 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2021-01-27T09:28:33.152 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.152 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.153 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.153 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_service_pp 2021-01-27T09:28:33.153 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32614 2021-01-27T09:28:33.153 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_service_pp on pid 32614' 2021-01-27T09:28:33.153 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32614 2021-01-27T09:28:33.154 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.154 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.154 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2021-01-27T09:28:33.154 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_service: /' 2021-01-27T09:28:33.155 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_service 2021-01-27T09:28:33.155 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_service.log 2021-01-27T09:28:33.155 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_c_write_operations 2021-01-27T09:28:33.155 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_c_write_operations' 2021-01-27T09:28:33.155 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.156 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.156 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.156 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.156 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_service_pp 2021-01-27T09:28:33.156 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_service_pp.log 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_c_write_operations 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_service_pp: /' 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_c_write_operations 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32622 2021-01-27T09:28:33.157 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_c_write_operations on pid 32622' 2021-01-27T09:28:33.158 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32622 2021-01-27T09:28:33.158 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.158 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.158 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s api_c_read_operations 2021-01-27T09:28:33.159 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' api_c_read_operations' 2021-01-27T09:28:33.159 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2021-01-27T09:28:33.159 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.159 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo api_c_read_operations 2021-01-27T09:28:33.159 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.160 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.160 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.160 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.160 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_c_write_operations: /' 2021-01-27T09:28:33.160 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2021-01-27T09:28:33.161 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=api_c_read_operations 2021-01-27T09:28:33.161 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_c_write_operations 2021-01-27T09:28:33.161 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32631 2021-01-27T09:28:33.161 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test api_c_read_operations on pid 32631' 2021-01-27T09:28:33.161 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32631 2021-01-27T09:28:33.162 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.162 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.162 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2021-01-27T09:28:33.162 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s list_parallel 2021-01-27T09:28:33.162 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' list_parallel' 2021-01-27T09:28:33.163 INFO:tasks.workunit.client.0.smithi103.stdout:test api_cmd_pp on pid 32575 2021-01-27T09:28:33.163 INFO:tasks.workunit.client.0.smithi103.stdout:test api_service on pid 32598 2021-01-27T09:28:33.163 INFO:tasks.workunit.client.0.smithi103.stdout:test api_service_pp on pid 32614 2021-01-27T09:28:33.163 INFO:tasks.workunit.client.0.smithi103.stdout:test api_c_write_operations on pid 32622 2021-01-27T09:28:33.163 INFO:tasks.workunit.client.0.smithi103.stdout:test api_c_read_operations on pid 32631 2021-01-27T09:28:33.165 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.165 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.165 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.165 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.166 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ api_c_read_operations: /' 2021-01-27T09:28:33.166 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2021-01-27T09:28:33.166 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_api_c_read_operations 2021-01-27T09:28:33.166 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo list_parallel 2021-01-27T09:28:33.166 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.167 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=list_parallel 2021-01-27T09:28:33.167 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32664 2021-01-27T09:28:33.167 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test list_parallel on pid 32664' 2021-01-27T09:28:33.167 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32664 2021-01-27T09:28:33.167 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.168 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.168 INFO:tasks.workunit.client.0.smithi103.stdout:test list_parallel on pid 32664 2021-01-27T09:28:33.169 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2021-01-27T09:28:33.169 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.169 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s open_pools_parallel 2021-01-27T09:28:33.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' open_pools_parallel' 2021-01-27T09:28:33.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_list_parallel.log 2021-01-27T09:28:33.171 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_list_parallel 2021-01-27T09:28:33.172 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ list_parallel: /' 2021-01-27T09:28:33.173 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.174 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo open_pools_parallel 2021-01-27T09:28:33.177 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=open_pools_parallel 2021-01-27T09:28:33.178 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32721 2021-01-27T09:28:33.178 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test open_pools_parallel on pid 32721' 2021-01-27T09:28:33.178 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32721 2021-01-27T09:28:33.178 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-27T09:28:33.178 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.179 INFO:tasks.workunit.client.0.smithi103.stdout:test open_pools_parallel on pid 32721 2021-01-27T09:28:33.179 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2021-01-27T09:28:33.181 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.181 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.181 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.181 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.182 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2021-01-27T09:28:33.182 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ open_pools_parallel: /' 2021-01-27T09:28:33.183 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_open_pools_parallel 2021-01-27T09:28:33.185 INFO:tasks.workunit.client.0.smithi103.stderr:++ printf %25s delete_pools_parallel 2021-01-27T09:28:33.186 INFO:tasks.workunit.client.0.smithi103.stderr:+ r=' delete_pools_parallel' 2021-01-27T09:28:33.186 INFO:tasks.workunit.client.0.smithi103.stderr:++ awk '{print $1}' 2021-01-27T09:28:33.187 INFO:tasks.workunit.client.0.smithi103.stderr:++ echo delete_pools_parallel 2021-01-27T09:28:33.191 INFO:tasks.workunit.client.0.smithi103.stderr:+ ff=delete_pools_parallel 2021-01-27T09:28:33.192 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32748 2021-01-27T09:28:33.192 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo 'test delete_pools_parallel on pid 32748' 2021-01-27T09:28:33.192 INFO:tasks.workunit.client.0.smithi103.stderr:+ pids[$f]=32748 2021-01-27T09:28:33.192 INFO:tasks.workunit.client.0.smithi103.stderr:+ ret=0 2021-01-27T09:28:33.192 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' 1 -eq 1 ']' 2021-01-27T09:28:33.193 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:28:33.193 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32159 2021-01-27T09:28:33.193 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32159 2021-01-27T09:28:33.193 INFO:tasks.workunit.client.0.smithi103.stdout:test delete_pools_parallel on pid 32748 2021-01-27T09:28:33.194 INFO:tasks.workunit.client.0.smithi103.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2021-01-27T09:28:33.198 INFO:tasks.workunit.client.0.smithi103.stderr:+ '[' -z '' ']' 2021-01-27T09:28:33.198 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.199 INFO:tasks.workunit.client.0.smithi103.stderr:+ case $- in 2021-01-27T09:28:33.199 INFO:tasks.workunit.client.0.smithi103.stderr:+ return 2021-01-27T09:28:33.202 INFO:tasks.workunit.client.0.smithi103.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2021-01-27T09:28:33.203 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_rados_delete_pools_parallel 2021-01-27T09:28:33.203 INFO:tasks.workunit.client.0.smithi103.stderr:+ sed 's/^/ delete_pools_parallel: /' 2021-01-27T09:28:34.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:33 smithi047 bash[9721]: cluster 2021-01-27T09:28:32.334716+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:33 smithi047 bash[9721]: audit 2021-01-27T09:28:33.116860+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:33 smithi047 bash[9721]: audit 2021-01-27T09:28:33.137373+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.103:0/2851396880' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-27T09:28:34.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:34 smithi103 bash[10018]: debug 2021-01-27T09:28:34.079+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[13570]: cluster 2021-01-27T09:28:32.334716+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[13570]: audit 2021-01-27T09:28:33.116860+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[13570]: audit 2021-01-27T09:28:33.137373+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.103:0/2851396880' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-27T09:28:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[9772]: cluster 2021-01-27T09:28:32.334716+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[9772]: audit 2021-01-27T09:28:33.116860+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:33 smithi103 bash[9772]: audit 2021-01-27T09:28:33.137373+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.103:0/2851396880' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-27T09:28:39.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:39 smithi103 bash[9772]: audit 2021-01-27T09:28:33.907167+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:39.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:39 smithi103 bash[13570]: audit 2021-01-27T09:28:33.907167+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:39.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:39 smithi047 bash[9721]: audit 2021-01-27T09:28:33.907167+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:43.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:33.919793+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.103:0/2144118329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:33.922122+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.103:0/3635370402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:34.083567+0000 mgr.y (mgr.14138) 476 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:43.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: cluster 2021-01-27T09:28:34.335382+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 196 pgs: 64 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:43.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:37.654300+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:43.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: cluster 2021-01-27T09:28:39.336027+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T09:28:43.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:39.347752+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:42 smithi047 bash[9721]: audit 2021-01-27T09:28:39.356266+0000 mon.a (mon.0) 663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:33.919793+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.103:0/2144118329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:33.922122+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.103:0/3635370402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:34.083567+0000 mgr.y (mgr.14138) 476 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:43.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: cluster 2021-01-27T09:28:34.335382+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 196 pgs: 64 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:43.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:37.654300+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:43.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: cluster 2021-01-27T09:28:39.336027+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T09:28:43.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:39.347752+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[9772]: audit 2021-01-27T09:28:39.356266+0000 mon.a (mon.0) 663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:33.919793+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.103:0/2144118329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:33.922122+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.103:0/3635370402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:34.083567+0000 mgr.y (mgr.14138) 476 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:43.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: cluster 2021-01-27T09:28:34.335382+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 196 pgs: 64 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:43.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:37.654300+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:43.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: cluster 2021-01-27T09:28:39.336027+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T09:28:43.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:39.347752+0000 mon.a (mon.0) 662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:43.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:42 smithi103 bash[13570]: audit 2021-01-27T09:28:39.356266+0000 mon.a (mon.0) 663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:36.336537+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v340: 196 pgs: 7 creating+peering, 57 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:38.337270+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v341: 196 pgs: 14 creating+peering, 50 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.363021+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.103:0/1287523730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.363478+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.363877+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.103:0/3459826148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.364107+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.103:0/627523629' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.364344+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.103:0/3186324637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.365344+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.103:0/1098436608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:39.367865+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.103:0/3191485534' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:40.338138+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v343: 612 pgs: 85 creating+peering, 395 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:42.297640+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T09:28:44.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:42.339685+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 612 pgs: 143 creating+peering, 337 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.738253+0000 mon.a (mon.0) 665 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.738528+0000 mon.a (mon.0) 666 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.738770+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:44.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.747355+0000 mon.a (mon.0) 668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.747618+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.756023+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.103:0/2202210446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.756367+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.103:0/339260424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.756625+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.103:0/2671962199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:42.756779+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.103:0/3482159232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: cluster 2021-01-27T09:28:43.174145+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T09:28:44.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.175163+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.175601+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.176031+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.179580+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.179904+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.180123+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.180886+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.181119+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.181487+0000 mon.a (mon.0) 678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.060 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.183000+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.060 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.188520+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.060 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.189366+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.060 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.629189+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.061 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.629495+0000 mon.a (mon.0) 683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.061 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.629735+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.061 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:43 smithi047 bash[9721]: audit 2021-01-27T09:28:43.630693+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.092 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:36.336537+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v340: 196 pgs: 7 creating+peering, 57 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.092 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:38.337270+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v341: 196 pgs: 14 creating+peering, 50 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.363021+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.103:0/1287523730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.363478+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.093 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.363877+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.103:0/3459826148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.364107+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.103:0/627523629' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.364344+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.103:0/3186324637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.094 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.365344+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.103:0/1098436608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:39.367865+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.103:0/3191485534' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:40.338138+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v343: 612 pgs: 85 creating+peering, 395 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:42.297640+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T09:28:44.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:42.339685+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 612 pgs: 143 creating+peering, 337 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.738253+0000 mon.a (mon.0) 665 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.738528+0000 mon.a (mon.0) 666 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.738770+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:44.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.747355+0000 mon.a (mon.0) 668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.747618+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.096 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.756023+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.103:0/2202210446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.097 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.756367+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.103:0/339260424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.097 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.756625+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.103:0/2671962199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.097 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:42.756779+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.103:0/3482159232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.097 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: cluster 2021-01-27T09:28:43.174145+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T09:28:44.098 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.175163+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.098 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.175601+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.098 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.176031+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.098 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.179580+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.098 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.179904+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.180123+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.180886+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.181119+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.181487+0000 mon.a (mon.0) 678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.183000+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.188520+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.189366+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.629189+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.100 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.629495+0000 mon.a (mon.0) 683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.101 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.629735+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.101 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[9772]: audit 2021-01-27T09:28:43.630693+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:36.336537+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v340: 196 pgs: 7 creating+peering, 57 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:38.337270+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v341: 196 pgs: 14 creating+peering, 50 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:28:44.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.363021+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.103:0/1287523730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.363478+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.363877+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.103:0/3459826148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.364107+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.103:0/627523629' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.364344+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.103:0/3186324637' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.365344+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.103:0/1098436608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:39.367865+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.103:0/3191485534' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:40.338138+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v343: 612 pgs: 85 creating+peering, 395 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:42.297640+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T09:28:44.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:42.339685+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 612 pgs: 143 creating+peering, 337 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:28:44.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.738253+0000 mon.a (mon.0) 665 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.738528+0000 mon.a (mon.0) 666 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.738770+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.747355+0000 mon.a (mon.0) 668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.747618+0000 mon.a (mon.0) 669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32186-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.756023+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.103:0/2202210446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.756367+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.103:0/339260424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.756625+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.103:0/2671962199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:42.756779+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.103:0/3482159232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: cluster 2021-01-27T09:28:43.174145+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T09:28:44.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.175163+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.175601+0000 mon.a (mon.0) 671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.176031+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.179580+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.179904+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.180123+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.180886+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.181119+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.181487+0000 mon.a (mon.0) 678 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.183000+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.188520+0000 mon.a (mon.0) 680 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.189366+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.629189+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.629495+0000 mon.a (mon.0) 683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.629735+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:44.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:43 smithi103 bash[13570]: audit 2021-01-27T09:28:43.630693+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:44.110 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:44 smithi103 bash[10018]: debug 2021-01-27T09:28:44.087+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:44.215 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2021-01-27T09:28:44.215 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [----------] Global test environment set-up. 2021-01-27T09:28:44.215 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [----------] 12 tests from AsioRados 2021-01-27T09:28:44.216 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2021-01-27T09:28:44.216 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2021-01-27T09:28:44.216 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2021-01-27T09:28:44.216 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2021-01-27T09:28:44.216 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2021-01-27T09:28:44.217 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2021-01-27T09:28:44.217 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2021-01-27T09:28:44.217 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (16 ms) 2021-01-27T09:28:44.217 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2021-01-27T09:28:44.217 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (9 ms) 2021-01-27T09:28:44.218 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2021-01-27T09:28:44.218 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (9 ms) 2021-01-27T09:28:44.218 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2021-01-27T09:28:44.218 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2021-01-27T09:28:44.219 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2021-01-27T09:28:44.219 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2021-01-27T09:28:44.219 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2021-01-27T09:28:44.219 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2021-01-27T09:28:44.219 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2021-01-27T09:28:44.220 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (9 ms) 2021-01-27T09:28:44.220 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2021-01-27T09:28:44.220 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (7 ms) 2021-01-27T09:28:44.220 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2021-01-27T09:28:44.220 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (4 ms) 2021-01-27T09:28:44.221 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [----------] 12 tests from AsioRados (59 ms total) 2021-01-27T09:28:44.221 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: 2021-01-27T09:28:44.221 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [----------] Global test environment tear-down 2021-01-27T09:28:44.221 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (11217 ms total) 2021-01-27T09:28:44.221 INFO:tasks.workunit.client.0.smithi103.stdout: api_asio: [ PASSED ] 12 tests. 2021-01-27T09:28:44.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:44.745 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [==========] Running 10 tests from 3 test suites. 2021-01-27T09:28:44.746 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] Global test environment set-up. 2021-01-27T09:28:44.746 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 6 tests from LibRadosList 2021-01-27T09:28:44.746 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2021-01-27T09:28:44.746 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.ListObjects (487 ms) 2021-01-27T09:28:44.746 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2021-01-27T09:28:44.747 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo1,foo2,foo3 2021-01-27T09:28:44.747 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo1 2021-01-27T09:28:44.747 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo2 2021-01-27T09:28:44.747 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo3 2021-01-27T09:28:44.747 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo1,foo4,foo5 2021-01-27T09:28:44.748 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo4 2021-01-27T09:28:44.748 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo5 2021-01-27T09:28:44.748 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo1 2021-01-27T09:28:44.748 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo6,foo7 2021-01-27T09:28:44.748 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo7 2021-01-27T09:28:44.749 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo6 2021-01-27T09:28:44.749 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-01-27T09:28:44.749 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo4 2021-01-27T09:28:44.749 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo5 2021-01-27T09:28:44.750 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns2:foo7 2021-01-27T09:28:44.750 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns2:foo6 2021-01-27T09:28:44.750 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo1 2021-01-27T09:28:44.750 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo1 2021-01-27T09:28:44.750 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo2 2021-01-27T09:28:44.751 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo3 2021-01-27T09:28:44.751 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (152 ms) 2021-01-27T09:28:44.751 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2021-01-27T09:28:44.751 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 1 0 2021-01-27T09:28:44.752 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 10 0 2021-01-27T09:28:44.753 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 13 0 2021-01-27T09:28:44.753 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 7 0 2021-01-27T09:28:44.754 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 14 0 2021-01-27T09:28:44.754 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 0 0 2021-01-27T09:28:44.754 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 15 0 2021-01-27T09:28:44.755 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 11 0 2021-01-27T09:28:44.755 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 5 0 2021-01-27T09:28:44.755 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 8 0 2021-01-27T09:28:44.755 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 6 0 2021-01-27T09:28:44.756 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 3 0 2021-01-27T09:28:44.756 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 4 0 2021-01-27T09:28:44.756 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 12 0 2021-01-27T09:28:44.756 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 9 0 2021-01-27T09:28:44.757 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 2 0 2021-01-27T09:28:44.757 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-01-27T09:28:44.757 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (136 ms) 2021-01-27T09:28:44.757 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2021-01-27T09:28:44.757 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: x cursor=MIN 2021-01-27T09:28:44.758 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=1 cursor=25:02547ec2:::1:head 2021-01-27T09:28:44.758 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=10 cursor=25:52ea6a34:::10:head 2021-01-27T09:28:44.758 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=13 cursor=25:566253c9:::13:head 2021-01-27T09:28:44.758 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=7 cursor=25:5c6b0b28:::7:head 2021-01-27T09:28:44.759 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=14 cursor=25:62a1935d:::14:head 2021-01-27T09:28:44.759 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=0 cursor=25:6cac518f:::0:head 2021-01-27T09:28:44.759 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=15 cursor=25:863748b0:::15:head 2021-01-27T09:28:44.760 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=11 cursor=25:89d3ae78:::11:head 2021-01-27T09:28:44.760 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=5 cursor=25:b29083e3:::5:head 2021-01-27T09:28:44.761 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=8 cursor=25:bd63b0f1:::8:head 2021-01-27T09:28:44.761 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=6 cursor=25:c4fdafeb:::6:head 2021-01-27T09:28:44.761 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=3 cursor=25:cfc208b3:::3:head 2021-01-27T09:28:44.761 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=4 cursor=25:d83876eb:::4:head 2021-01-27T09:28:44.762 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=12 cursor=25:de5d7c5f:::12:head 2021-01-27T09:28:44.762 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=9 cursor=25:e960b815:::9:head 2021-01-27T09:28:44.762 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > oid=2 cursor=25:f905c69b:::2:head 2021-01-27T09:28:44.762 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: FIRST> seek to MIN oid=1 2021-01-27T09:28:44.762 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=1 cursor=25:02547ec2:::1:head 2021-01-27T09:28:44.763 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:02547ec2:::1:head 2021-01-27T09:28:44.763 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:02547ec2:::1:head -> 1 2021-01-27T09:28:44.763 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=10 cursor=25:52ea6a34:::10:head 2021-01-27T09:28:44.763 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:52ea6a34:::10:head 2021-01-27T09:28:44.763 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:52ea6a34:::10:head -> 10 2021-01-27T09:28:44.764 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=13 cursor=25:566253c9:::13:head 2021-01-27T09:28:44.764 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:566253c9:::13:head 2021-01-27T09:28:44.764 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:566253c9:::13:head -> 13 2021-01-27T09:28:44.764 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=7 cursor=25:5c6b0b28:::7:head 2021-01-27T09:28:44.764 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:5c6b0b28:::7:head 2021-01-27T09:28:44.765 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:5c6b0b28:::7:head -> 7 2021-01-27T09:28:44.765 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=14 cursor=25:62a1935d:::14:head 2021-01-27T09:28:44.765 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:62a1935d:::14:head 2021-01-27T09:28:44.765 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:62a1935d:::14:head -> 14 2021-01-27T09:28:44.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=0 cursor=25:6cac518f:::0:head 2021-01-27T09:28:44.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:6cac518f:::0:head 2021-01-27T09:28:44.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:6cac518f:::0:head -> 0 2021-01-27T09:28:44.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=15 cursor=25:863748b0:::15:head 2021-01-27T09:28:44.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:863748b0:::15:head 2021-01-27T09:28:44.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:863748b0:::15:head -> 15 2021-01-27T09:28:44.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=11 cursor=25:89d3ae78:::11:head 2021-01-27T09:28:44.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:89d3ae78:::11:head 2021-01-27T09:28:44.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:89d3ae78:::11:head -> 11 2021-01-27T09:28:44.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=5 cursor=25:b29083e3:::5:head 2021-01-27T09:28:44.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:b29083e3:::5:head 2021-01-27T09:28:44.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:b29083e3:::5:head -> 5 2021-01-27T09:28:44.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=8 cursor=25:bd63b0f1:::8:head 2021-01-27T09:28:44.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:bd63b0f1:::8:head 2021-01-27T09:28:44.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:bd63b0f1:::8:head -> 8 2021-01-27T09:28:44.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=6 cursor=25:c4fdafeb:::6:head 2021-01-27T09:28:44.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:c4fdafeb:::6:head 2021-01-27T09:28:44.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:c4fdafeb:::6:head -> 6 2021-01-27T09:28:44.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=3 cursor=25:cfc208b3:::3:head 2021-01-27T09:28:44.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:cfc208b3:::3:head 2021-01-27T09:28:44.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:cfc208b3:::3:head -> 3 2021-01-27T09:28:44.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=4 cursor=25:d83876eb:::4:head 2021-01-27T09:28:44.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:d83876eb:::4:head 2021-01-27T09:28:44.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:d83876eb:::4:head -> 4 2021-01-27T09:28:44.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=12 cursor=25:de5d7c5f:::12:head 2021-01-27T09:28:44.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:de5d7c5f:::12:head 2021-01-27T09:28:44.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:de5d7c5f:::12:head -> 12 2021-01-27T09:28:44.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=9 cursor=25:e960b815:::9:head 2021-01-27T09:28:44.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:e960b815:::9:head 2021-01-27T09:28:44.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:e960b815:::9:head -> 9 2021-01-27T09:28:44.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : oid=2 cursor=25:f905c69b:::2:head 2021-01-27T09:28:44.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:f905c69b:::2:head 2021-01-27T09:28:44.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:f905c69b:::2:head -> 2 2021-01-27T09:28:44.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:863748b0:::15:head 2021-01-27T09:28:44.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:863748b0:::15:head expected=25:863748b0:::15:head 2021-01-27T09:28:44.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:863748b0:::15:head -> 15 2021-01-27T09:28:44.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=15 expected=15 2021-01-27T09:28:44.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:bd63b0f1:::8:head 2021-01-27T09:28:44.991 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:bd63b0f1:::8:head expected=25:bd63b0f1:::8:head 2021-01-27T09:28:44.991 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:bd63b0f1:::8:head -> 8 2021-01-27T09:28:44.991 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=8 expected=8 2021-01-27T09:28:44.991 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:b29083e3:::5:head 2021-01-27T09:28:44.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:b29083e3:::5:head expected=25:b29083e3:::5:head 2021-01-27T09:28:44.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:b29083e3:::5:head -> 5 2021-01-27T09:28:44.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=5 expected=5 2021-01-27T09:28:44.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:89d3ae78:::11:head 2021-01-27T09:28:44.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:89d3ae78:::11:head expected=25:89d3ae78:::11:head 2021-01-27T09:28:44.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:89d3ae78:::11:head -> 11 2021-01-27T09:28:44.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=11 expected=11 2021-01-27T09:28:44.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:6cac518f:::0:head 2021-01-27T09:28:44.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:6cac518f:::0:head expected=25:6cac518f:::0:head 2021-01-27T09:28:44.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:6cac518f:::0:head -> 0 2021-01-27T09:28:44.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=0 expected=0 2021-01-27T09:28:44.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:f905c69b:::2:head 2021-01-27T09:28:44.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:f905c69b:::2:head expected=25:f905c69b:::2:head 2021-01-27T09:28:44.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:f905c69b:::2:head -> 2 2021-01-27T09:28:44.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=2 expected=2 2021-01-27T09:28:44.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:e960b815:::9:head 2021-01-27T09:28:44.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:e960b815:::9:head expected=25:e960b815:::9:head 2021-01-27T09:28:44.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:e960b815:::9:head -> 9 2021-01-27T09:28:44.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=9 expected=9 2021-01-27T09:28:44.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:de5d7c5f:::12:head 2021-01-27T09:28:44.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:de5d7c5f:::12:head expected=25:de5d7c5f:::12:head 2021-01-27T09:28:44.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:de5d7c5f:::12:head -> 12 2021-01-27T09:28:44.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=12 expected=12 2021-01-27T09:28:44.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:d83876eb:::4:head 2021-01-27T09:28:45.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765257+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765335+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765439+0000 mon.a (mon.0) 688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765573+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765660+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765773+0000 mon.a (mon.0) 691 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765864+0000 mon.a (mon.0) 692 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.765948+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766010+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766095+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766305+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766396+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766484+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766634+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766738+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766822+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.766968+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:45.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: cluster 2021-01-27T09:28:43.767053+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T09:28:45.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.774331+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.781056+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.788053+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.103:0/4175221930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:43.789102+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:44.092568+0000 mgr.y (mgr.14138) 482 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:45.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:44.339582+0000 mon.a (mon.0) 706 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:44.349175+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[13570]: audit 2021-01-27T09:28:44.349688+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:45.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765257+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765335+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765439+0000 mon.a (mon.0) 688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765573+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765660+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765773+0000 mon.a (mon.0) 691 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765864+0000 mon.a (mon.0) 692 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.765948+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766010+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766095+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766305+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766396+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766484+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766634+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766738+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766822+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.766968+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:45.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: cluster 2021-01-27T09:28:43.767053+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T09:28:45.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.774331+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.781056+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.788053+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.103:0/4175221930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:43.789102+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:44.092568+0000 mgr.y (mgr.14138) 482 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:45.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:44.339582+0000 mon.a (mon.0) 706 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:44.349175+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:45 smithi103 bash[9772]: audit 2021-01-27T09:28:44.349688+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:45.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765257+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.103:0/1746876098' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32180-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765335+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.103:0/1774656296' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32212-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765439+0000 mon.a (mon.0) 688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765573+0000 mon.a (mon.0) 689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32594-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765660+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765773+0000 mon.a (mon.0) 691 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765864+0000 mon.a (mon.0) 692 : audit [INF] from='client.? 172.21.15.103:0/4199270518' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.765948+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.103:0/578940055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32644-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766010+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32217-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766095+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766305+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32466-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766396+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766484+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766634+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766738+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32473-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766822+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32449-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:45.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.766968+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32520-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:45.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: cluster 2021-01-27T09:28:43.767053+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T09:28:45.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.774331+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.781056+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:45.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.788053+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.103:0/4175221930' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:43.789102+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:45.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:44.092568+0000 mgr.y (mgr.14138) 482 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:45.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:44.339582+0000 mon.a (mon.0) 706 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:44.349175+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:45.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:45 smithi047 bash[9721]: audit 2021-01-27T09:28:44.349688+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:46.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:d83876eb:::4:head expected=25:d83876eb: api_c_read_operations: Running main() from gmock_main.cc 2021-01-27T09:28:46.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2021-01-27T09:28:46.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [----------] Global test environment set-up. 2021-01-27T09:28:46.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2021-01-27T09:28:46.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2021-01-27T09:28:46.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2021-01-27T09:28:46.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2021-01-27T09:28:46.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (407 ms) 2021-01-27T09:28:46.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2021-01-27T09:28:46.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (48 ms) 2021-01-27T09:28:46.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2021-01-27T09:28:46.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (11 ms) 2021-01-27T09:28:46.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2021-01-27T09:28:46.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (36 ms) 2021-01-27T09:28:46.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2021-01-27T09:28:46.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2021-01-27T09:28:46.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2021-01-27T09:28:46.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2021-01-27T09:28:46.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2021-01-27T09:28:46.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (6 ms) 2021-01-27T09:28:46.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2021-01-27T09:28:46.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (12 ms) 2021-01-27T09:28:46.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2021-01-27T09:28:46.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (7 ms) 2021-01-27T09:28:46.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2021-01-27T09:28:46.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (7 ms) 2021-01-27T09:28:46.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2021-01-27T09:28:46.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (12 ms) 2021-01-27T09:28:46.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2021-01-27T09:28:46.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (29 ms) 2021-01-27T09:28:46.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2021-01-27T09:28:46.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (17 ms) 2021-01-27T09:28:46.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2021-01-27T09:28:46.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (15 ms) 2021-01-27T09:28:46.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2021-01-27T09:28:46.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (6 ms) 2021-01-27T09:28:46.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (631 ms total) 2021-01-27T09:28:46.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: 2021-01-27T09:28:46.368 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [----------] Global test environment tear-down 2021-01-27T09:28:46.368 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (13198 ms total) 2021-01-27T09:28:46.368 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2021-01-27T09:28:47.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: cluster 2021-01-27T09:28:44.340594+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 868 pgs: 408 creating+peering, 328 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:47.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.338337+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.338907+0000 mon.a (mon.0) 710 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:47.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.340640+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: cluster 2021-01-27T09:28:45.340699+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T09:28:47.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.344113+0000 mon.a (mon.0) 712 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:47.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.352609+0000 mon.a (mon.0) 713 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:47.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.356677+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.857487+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:47.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:45.950592+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:47.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:46.338037+0000 mon.a (mon.0) 716 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: cluster 2021-01-27T09:28:46.339151+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T09:28:47.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:46.339296+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.103:0/2715691828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[13570]: audit 2021-01-27T09:28:46.339881+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: cluster 2021-01-27T09:28:44.340594+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 868 pgs: 408 creating+peering, 328 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:47.151 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.338337+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.151 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.338907+0000 mon.a (mon.0) 710 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:47.151 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.340640+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.152 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: cluster 2021-01-27T09:28:45.340699+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T09:28:47.152 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.344113+0000 mon.a (mon.0) 712 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:47.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.352609+0000 mon.a (mon.0) 713 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:47.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.356677+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.857487+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:47.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:45.950592+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:47.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:46.338037+0000 mon.a (mon.0) 716 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: cluster 2021-01-27T09:28:46.339151+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T09:28:47.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:46.339296+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.103:0/2715691828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:46 smithi103 bash[9772]: audit 2021-01-27T09:28:46.339881+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: cluster 2021-01-27T09:28:44.340594+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 868 pgs: 408 creating+peering, 328 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T09:28:47.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.338337+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.338907+0000 mon.a (mon.0) 710 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32186-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:47.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.340640+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: cluster 2021-01-27T09:28:45.340699+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T09:28:47.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.344113+0000 mon.a (mon.0) 712 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:47.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.352609+0000 mon.a (mon.0) 713 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:47.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.356677+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.857487+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:47.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:45.950592+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:47.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:46.338037+0000 mon.a (mon.0) 716 : audit [INF] from='client.? 172.21.15.103:0/645176416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:47.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: cluster 2021-01-27T09:28:46.339151+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T09:28:47.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:46.339296+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.103:0/2715691828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:47.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:46 smithi047 bash[9721]: audit 2021-01-27T09:28:46.339881+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.093 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: starting. 2021-01-27T09:28:48.093 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: creating pool ceph_test_rados_list_parallel.smithi103-32685 2021-01-27T09:28:48.093 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: created object 0... 2021-01-27T09:28:48.093 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: created object 25... 2021-01-27T09:28:48.094 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: created object 49... 2021-01-27T09:28:48.094 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: finishing. 2021-01-27T09:28:48.094 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_1_[32731]: shutting down. 2021-01-27T09:28:48.094 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: starting. 2021-01-27T09:28:48.095 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: listing objects. 2021-01-27T09:28:48.095 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: listed object 0... 2021-01-27T09:28:48.095 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: listed object 25... 2021-01-27T09:28:48.095 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: saw 50 objects 2021-01-27T09:28:48.095 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_2_[32732]: shutting down. 2021-01-27T09:28:48.096 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.096 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: starting. 2021-01-27T09:28:48.096 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: creating pool ceph_test_rados_list_parallel.smithi103-32685 2021-01-27T09:28:48.096 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: created object 0... 2021-01-27T09:28:48.096 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: created object 25... 2021-01-27T09:28:48.097 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: created object 49... 2021-01-27T09:28:48.097 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: finishing. 2021-01-27T09:28:48.097 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_3_[33147]: shutting down. 2021-01-27T09:28:48.097 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.097 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: starting. 2021-01-27T09:28:48.099 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: listing objects. 2021-01-27T09:28:48.099 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: listed object 0... 2021-01-27T09:28:48.099 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: listed object 25... 2021-01-27T09:28:48.099 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: saw 50 objects 2021-01-27T09:28:48.099 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_4_[33148]: shutting down. 2021-01-27T09:28:48.100 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.100 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: starting. 2021-01-27T09:28:48.100 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: removed 25 objects... 2021-01-27T09:28:48.101 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: removed half of the objects 2021-01-27T09:28:48.101 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: removed 50 objects... 2021-01-27T09:28:48.101 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: removed 50 objects 2021-01-27T09:28:48.102 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_5_[33149]: shutting down. 2021-01-27T09:28:48.102 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.102 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.102 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: starting. 2021-01-27T09:28:48.103 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: creating pool ceph_test_rados_list_parallel.smithi103-32685 2021-01-27T09:28:48.103 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: created object 0... 2021-01-27T09:28:48.103 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: created object 25... 2021-01-27T09:28:48.103 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: created object 49... 2021-01-27T09:28:48.103 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: finishing. 2021-01-27T09:28:48.104 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_6_[33332]: shutting down. 2021-01-27T09:28:48.104 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.104 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.104 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: starting. 2021-01-27T09:28:48.104 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: added 25 objects... 2021-01-27T09:28:48.105 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: added half of the objects 2021-01-27T09:28:48.105 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: added 50 objects... 2021-01-27T09:28:48.105 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: added 50 objects 2021-01-27T09:28:48.105 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_8_[33334]: shutting down. 2021-01-27T09:28:48.106 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.106 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.106 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: starting. 2021-01-27T09:28:48.107 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: listing objects. 2021-01-27T09:28:48.107 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: listed object 0... 2021-01-27T09:28:48.107 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: listed object 25... 2021-01-27T09:28:48.108 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: listed object 50... 2021-01-27T09:28:48.108 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: listed object 75... 2021-01-27T09:28:48.108 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: saw 100 objects 2021-01-27T09:28:48.109 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_7_[33333]: shutting down. 2021-01-27T09:28:48.109 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:48.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: cluster 2021-01-27T09:28:46.341428+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v350: 652 pgs: 223 creating+peering, 170 unknown, 259 active+clean; 30 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2021-01-27T09:28:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:46.854339+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:46.864666+0000 mon.a (mon.0) 720 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:46.864822+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:46.867433+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: cluster 2021-01-27T09:28:47.344670+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T09:28:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.358039+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.791790+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.793574+0000 mon.a (mon.0) 724 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.796658+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:48.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.800601+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.801125+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:48.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.801531+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:48 smithi047 bash[9721]: audit 2021-01-27T09:28:47.801989+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.656 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: cluster 2021-01-27T09:28:46.341428+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v350: 652 pgs: 223 creating+peering, 170 unknown, 259 active+clean; 30 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2021-01-27T09:28:48.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:46.854339+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:48.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:46.864666+0000 mon.a (mon.0) 720 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:48.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:46.864822+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:48.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:46.867433+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: cluster 2021-01-27T09:28:47.344670+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T09:28:48.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.358039+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:48.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.791790+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.671 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.793574+0000 mon.a (mon.0) 724 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.796658+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:48.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.800601+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.801125+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:48.672 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.801531+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.673 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[13570]: audit 2021-01-27T09:28:47.801989+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: cluster 2021-01-27T09:28:46.341428+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v350: 652 pgs: 223 creating+peering, 170 unknown, 259 active+clean; 30 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2021-01-27T09:28:48.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:46.854339+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:48.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:46.864666+0000 mon.a (mon.0) 720 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:48.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:46.864822+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:48.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:46.867433+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:48.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: cluster 2021-01-27T09:28:47.344670+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T09:28:48.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.358039+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:48.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.791790+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.793574+0000 mon.a (mon.0) 724 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:48.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.796658+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:48.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.800601+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.801125+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:48.676 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.801531+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:48.676 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:48 smithi103 bash[9772]: audit 2021-01-27T09:28:47.801989+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.281 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ************** api_cmd: Running main() from gmock_main.cc 2021-01-27T09:28:49.281 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2021-01-27T09:28:49.281 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [----------] Global test environment set-up. 2021-01-27T09:28:49.282 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2021-01-27T09:28:49.282 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2021-01-27T09:28:49.282 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (33 ms) 2021-01-27T09:28:49.282 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2021-01-27T09:28:49.283 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (776 ms) 2021-01-27T09:28:49.283 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2021-01-27T09:28:49.283 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (14420 ms) 2021-01-27T09:28:49.283 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2021-01-27T09:28:49.283 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:46.864666+0000 mon.a [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32186-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:49.284 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:46.864822+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:49.284 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:46.867433+0000 mon.c [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.284 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.358039+0000 mon.c [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.284 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.791790+0000 mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:49.284 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.793574+0000 mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:49.285 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.796658+0000 mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.285 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.800601+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.285 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.801125+0000 mon.a [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:49.285 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.801531+0000 mon.c [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.286 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:47.801989+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.286 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.268495+0000 mon.a [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:49.286 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.280597+0000 mon.a [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:49.286 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.281354+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.286 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.281918+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.287 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.282216+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.287 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.289323+0000 mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:49.287 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.289481+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:49.287 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.339571+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.287 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.341704+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.288 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.346528+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.288 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.351490+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.288 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.358329+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.288 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.360913+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.288 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.362652+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.289 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.363736+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.289 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.364896+0000 mon.c [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.289 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.365572+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.289 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.367177+0000 mon.c [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.289 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.765320+0000 mon.c [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.290 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:48.765490+0000 mon.c [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.216440+0000 api_io_pp: Running main() from gmock_main.cc 2021-01-27T09:28:49.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2021-01-27T09:28:49.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] Global test environment set-up. 2021-01-27T09:28:49.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2021-01-27T09:28:49.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: seed 32186 2021-01-27T09:28:49.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2021-01-27T09:28:49.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2021-01-27T09:28:49.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2021-01-27T09:28:49.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (74 ms) 2021-01-27T09:28:49.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2021-01-27T09:28:49.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (7 ms) 2021-01-27T09:28:49.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2021-01-27T09:28:49.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (4 ms) 2021-01-27T09:28:49.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2021-01-27T09:28:49.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3 ms) 2021-01-27T09:28:49.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2021-01-27T09:28:49.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (4 ms) 2021-01-27T09:28:49.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2021-01-27T09:28:49.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3 ms) 2021-01-27T09:28:49.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2021-01-27T09:28:49.467 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (3 ms) 2021-01-27T09:28:49.467 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2021-01-27T09:28:49.467 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (8 ms) 2021-01-27T09:28:49.468 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2021-01-27T09:28:49.468 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (6 ms) 2021-01-27T09:28:49.468 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2021-01-27T09:28:49.468 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2021-01-27T09:28:49.469 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2021-01-27T09:28:49.469 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (7 ms) 2021-01-27T09:28:49.469 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2021-01-27T09:28:49.470 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (6 ms) 2021-01-27T09:28:49.470 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2021-01-27T09:28:49.471 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (7 ms) 2021-01-27T09:28:49.471 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2021-01-27T09:28:49.471 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (8 ms) 2021-01-27T09:28:49.472 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2021-01-27T09:28:49.472 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (21 ms) 2021-01-27T09:28:49.472 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-01-27T09:28:49.473 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (9 ms) 2021-01-27T09:28:49.473 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2021-01-27T09:28:49.473 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (9 ms) 2021-01-27T09:28:49.473 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2021-01-27T09:28:49.474 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2021-01-27T09:28:49.474 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2021-01-27T09:28:49.474 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (7 ms) 2021-01-27T09:28:49.475 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (195 ms total) 2021-01-27T09:28:49.475 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: 2021-01-27T09:28:49.475 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2021-01-27T09:28:49.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2021-01-27T09:28:49.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1628 ms) 2021-01-27T09:28:49.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2021-01-27T09:28:49.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (25 ms) 2021-01-27T09:28:49.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2021-01-27T09:28:49.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (5 ms) 2021-01-27T09:28:49.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2021-01-27T09:28:49.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (6 ms) 2021-01-27T09:28:49.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2021-01-27T09:28:49.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (5 ms) 2021-01-27T09:28:49.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: cluster 2021-01-27T09:28:48.268495+0000 mon.a (mon.0) 729 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:49.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.272206+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.280597+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.281354+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.281918+0000 mon.a (mon.0) 733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.282216+0000 mon.a (mon.0) 734 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.289323+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.289481+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.339571+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.340108+0000 mgr.y (mgr.14138) 485 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.341704+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: cluster 2021-01-27T09:28:48.342471+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v353: 660 pgs: 147 creating+peering, 215 unknown, 298 active+clean; 35 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 24 KiB/s wr, 34 op/s 2021-01-27T09:28:49.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.342836+0000 mgr.y (mgr.14138) 487 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.346528+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.346983+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.351490+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.351814+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.358329+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.358843+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.360913+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.361768+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.362652+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.362812+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.363736+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.363941+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.364896+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.365572+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.365735+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.367177+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.367834+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.765320+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:48.765490+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.209451+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T09:28:49.559 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.216440+0000 mon.a (mon.0) 738 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:49.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.217510+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.218892+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.228240+0000 mon.a (mon.0) 741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.229085+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.560 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.230188+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.230658+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.231252+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.231585+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.232276+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-27T09:28:49.561 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.232501+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.562 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.234698+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.562 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.235618+0000 mon.a (mon.0) 746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.562 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.235916+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.562 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:49 smithi047 bash[9721]: audit 2021-01-27T09:28:49.236232+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: cluster 2021-01-27T09:28:48.268495+0000 mon.a (mon.0) 729 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:49.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.272206+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:49.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.280597+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:49.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.281354+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.281918+0000 mon.a (mon.0) 733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.282216+0000 mon.a (mon.0) 734 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.289323+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:49.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.289481+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:49.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.339571+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.340108+0000 mgr.y (mgr.14138) 485 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.341704+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: cluster 2021-01-27T09:28:48.342471+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v353: 660 pgs: 147 creating+peering, 215 unknown, 298 active+clean; 35 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 24 KiB/s wr, 34 op/s 2021-01-27T09:28:49.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.342836+0000 mgr.y (mgr.14138) 487 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.346528+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.346983+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.351490+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.351814+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.358329+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.358843+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.360913+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.361768+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.362652+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.362812+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.363736+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.363941+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.364896+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.365572+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.365735+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.367177+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.367834+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.765320+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:48.765490+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.209451+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T09:28:49.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.216440+0000 mon.a (mon.0) 738 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:49.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.217510+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.218892+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.228240+0000 mon.a (mon.0) 741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.229085+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.230188+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.230658+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.231252+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.231585+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.232276+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-27T09:28:49.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.232501+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.234698+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.235618+0000 mon.a (mon.0) 746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.235916+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[9772]: audit 2021-01-27T09:28:49.236232+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: cluster 2021-01-27T09:28:48.268495+0000 mon.a (mon.0) 729 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:49.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.272206+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:49.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.280597+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:49.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.281354+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.657 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.281918+0000 mon.a (mon.0) 733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.282216+0000 mon.a (mon.0) 734 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:49.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.289323+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32466-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:49.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.289481+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:49.658 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.339571+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.340108+0000 mgr.y (mgr.14138) 485 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:28:49.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.341704+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: cluster 2021-01-27T09:28:48.342471+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v353: 660 pgs: 147 creating+peering, 215 unknown, 298 active+clean; 35 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 24 KiB/s wr, 34 op/s 2021-01-27T09:28:49.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.342836+0000 mgr.y (mgr.14138) 487 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:28:49.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.346528+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.346983+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:28:49.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.351490+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.351814+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:28:49.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.358329+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.358843+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:28:49.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.360913+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.361768+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:28:49.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.362652+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.362812+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:28:49.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.363736+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.363941+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:28:49.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.364896+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.662 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.365572+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.365735+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:28:49.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.367177+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.367834+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:28:49.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.765320+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.663 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:48.765490+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.209451+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T09:28:49.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.216440+0000 mon.a (mon.0) 738 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:49.664 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.217510+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.218892+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:49.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.228240+0000 mon.a (mon.0) 741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.229085+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.230188+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:49.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.230658+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.231252+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.231585+0000 mon.a (mon.0) 744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:49.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.232276+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-27T09:28:49.666 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.232501+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:49.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.234698+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.235618+0000 mon.a (mon.0) 746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.235916+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.667 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:49 smithi103 bash[13570]: audit 2021-01-27T09:28:49.236232+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:49.768 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] L api_cmd_pp: Running main() from gmock_main.cc 2021-01-27T09:28:49.768 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2021-01-27T09:28:49.769 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [----------] Global test environment set-up. 2021-01-27T09:28:49.769 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2021-01-27T09:28:49.769 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2021-01-27T09:28:49.769 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (40 ms) 2021-01-27T09:28:49.770 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2021-01-27T09:28:49.770 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (745 ms) 2021-01-27T09:28:49.770 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2021-01-27T09:28:49.770 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (15852 ms) 2021-01-27T09:28:49.770 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (16637 ms total) 2021-01-27T09:28:49.771 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: 2021-01-27T09:28:49.771 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [----------] Global test environment tear-down 2021-01-27T09:28:49.771 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (16638 ms total) 2021-01-27T09:28:49.771 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2021-01-27T09:28:50.447 INFO:tasks.workunit.client.0.smithi103.stdout:***************** 2021-01-27T09:28:50.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: starting. 2021-01-27T09:28:50.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: creating pool ceph_test_rados_list_parallel.smithi103-32685 2021-01-27T09:28:50.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: created object 0... 2021-01-27T09:28:50.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: created object 25... 2021-01-27T09:28:50.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: created object 49... 2021-01-27T09:28:50.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: finishing. 2021-01-27T09:28:50.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_9_[33433]: shutting down. 2021-01-27T09:28:50.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: starting. 2021-01-27T09:28:50.451 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: added 25 objects... 2021-01-27T09:28:50.451 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: added half of the objects 2021-01-27T09:28:50.451 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: added 50 objects... 2021-01-27T09:28:50.451 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: added 50 objects 2021-01-27T09:28:50.451 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_11_[33435]: shutting down. 2021-01-27T09:28:50.452 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.452 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.452 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.452 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: starting. 2021-01-27T09:28:50.453 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: listing objects. 2021-01-27T09:28:50.453 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: listed object 0... 2021-01-27T09:28:50.453 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: listed object 25... 2021-01-27T09:28:50.453 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: listed object 50... 2021-01-27T09:28:50.453 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: listed object 75... 2021-01-27T09:28:50.454 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: saw 91 objects 2021-01-27T09:28:50.454 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_10_[33434]: shutting down. 2021-01-27T09:28:50.454 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.454 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.455 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.455 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: starting. 2021-01-27T09:28:50.455 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: removed 25 objects... 2021-01-27T09:28:50.455 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: removed half of the objects 2021-01-27T09:28:50.456 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: removed 50 objects... 2021-01-27T09:28:50.456 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: removed 50 objects 2021-01-27T09:28:50.456 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_13_[33437]: shutting down. 2021-01-27T09:28:50.456 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.456 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.457 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.457 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: starting. 2021-01-27T09:28:50.457 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: added 25 objects... 2021-01-27T09:28:50.457 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: added half of the objects 2021-01-27T09:28:50.458 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: added 50 objects... 2021-01-27T09:28:50.458 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: added 50 objects 2021-01-27T09:28:50.458 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_12_[33436]: shutting down. 2021-01-27T09:28:50.458 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.458 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.459 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.459 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.459 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: starting. 2021-01-27T09:28:50.459 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: creating pool ceph_test_rados_list_parallel.smithi103-32685 2021-01-27T09:28:50.460 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: created object 0... 2021-01-27T09:28:50.460 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: created object 25... 2021-01-27T09:28:50.460 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: created object 49... 2021-01-27T09:28:50.460 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: finishing. 2021-01-27T09:28:50.460 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_14_[33549]: shutting down. 2021-01-27T09:28:50.461 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.461 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.461 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.462 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:50.462 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: starting. 2021-01-27T09:28:50.462 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listing objects. 2021-01-27T09:28:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: cluster 2021-01-27T09:28:48.604253+0000 osd.2 (osd.2) 3 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:28:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.273964+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.286168+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-27T09:28:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.287560+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.287763+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-27T09:28:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.290567+0000 mon.a (mon.0) 750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.295006+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.297971+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.307889+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.626790+0000 osd.0 (osd.0) 3 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:28:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.760552+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.760836+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.761309+0000 mon.a (mon.0) 754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.761710+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.762192+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.762656+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T09:28:51.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.762747+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.763786+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.764440+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.765520+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:51.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.776587+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:51.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:49.777148+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:50.221035+0000 mon.a (mon.0) 760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:50.228120+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:50.228811+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:50.229108+0000 mon.a (mon.0) 763 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:50 smithi047 bash[9721]: audit 2021-01-27T09:28:50.229569+0000 mon.a (mon.0) 764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:51.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: cluster 2021-01-27T09:28:48.604253+0000 osd.2 (osd.2) 3 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:28:51.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.273964+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:51.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.286168+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-27T09:28:51.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.287560+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.287763+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-27T09:28:51.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.290567+0000 mon.a (mon.0) 750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.295006+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.297971+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.307889+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.626790+0000 osd.0 (osd.0) 3 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:28:51.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.760552+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.760836+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.761309+0000 mon.a (mon.0) 754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.761710+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.762192+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.762656+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T09:28:51.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.762747+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.763786+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.764440+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.765520+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:51.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.776587+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:51.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:49.777148+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:50.221035+0000 mon.a (mon.0) 760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:50.228120+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:50.228811+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:50.229108+0000 mon.a (mon.0) 763 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[13570]: audit 2021-01-27T09:28:50.229569+0000 mon.a (mon.0) 764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:51.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: cluster 2021-01-27T09:28:48.604253+0000 osd.2 (osd.2) 3 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:28:51.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.273964+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:51.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.286168+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-27T09:28:51.153 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.287560+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.287763+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-27T09:28:51.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.290567+0000 mon.a (mon.0) 750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-27T09:28:51.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.295006+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.297971+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.154 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.307889+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.626790+0000 osd.0 (osd.0) 3 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:28:51.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.760552+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.760836+0000 mon.a (mon.0) 753 : audit [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:51.155 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.761309+0000 mon.a (mon.0) 754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.761710+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.762192+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:51.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.762656+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T09:28:51.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.762747+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.156 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.763786+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.764440+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.157 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.765520+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:51.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.776587+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:51.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:49.777148+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.159 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:50.221035+0000 mon.a (mon.0) 760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:51.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:50.228120+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:51.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:50.228811+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:51.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:50.229108+0000 mon.a (mon.0) 763 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:51.160 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:50 smithi103 bash[9772]: audit 2021-01-27T09:28:50.229569+0000 mon.a (mon.0) 764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:52.414 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object delete_pools_parallel: process_1_[32804]: starting. 2021-01-27T09:28:52.414 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: creating pool ceph_test_rados_delete_pools_parallel.smithi103-32756 2021-01-27T09:28:52.414 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: created object 0... 2021-01-27T09:28:52.415 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: created object 25... 2021-01-27T09:28:52.415 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: created object 49... 2021-01-27T09:28:52.415 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: finishing. 2021-01-27T09:28:52.415 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_1_[32804]: shutting down. 2021-01-27T09:28:52.416 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_2_[32806]: starting. 2021-01-27T09:28:52.416 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_2_[32806]: deleting pool ceph_test_rados_delete_pools_parallel.smithi103-32756 2021-01-27T09:28:52.416 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_2_[32806]: shutting down. 2021-01-27T09:28:52.416 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******************************* 2021-01-27T09:28:52.417 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: starting. 2021-01-27T09:28:52.417 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: creating pool ceph_test_rados_delete_pools_parallel.smithi103-32756 2021-01-27T09:28:52.417 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: created object 0... 2021-01-27T09:28:52.417 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: created object 25... 2021-01-27T09:28:52.418 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: created object 49... 2021-01-27T09:28:52.418 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: finishing. 2021-01-27T09:28:52.418 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_3_[33282]: shutting down. 2021-01-27T09:28:52.418 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******************************* 2021-01-27T09:28:52.419 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: starting. 2021-01-27T09:28:52.419 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: listing objects. 2021-01-27T09:28:52.419 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: listed object 0... 2021-01-27T09:28:52.419 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: listed object 25... 2021-01-27T09:28:52.420 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: saw 50 objects 2021-01-27T09:28:52.420 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_5_[33284]: shutting down. 2021-01-27T09:28:52.420 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******************************* 2021-01-27T09:28:52.420 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_4_[33283]: starting. 2021-01-27T09:28:52.420 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_4_[33283]: deleting pool ceph_test_rados_delete_pools_parallel.smithi103-32756 2021-01-27T09:28:52.421 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: process_4_[33283]: shutting down. 2021-01-27T09:28:52.421 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******************************* 2021-01-27T09:28:52.421 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******************************* 2021-01-27T09:28:52.421 INFO:tasks.workunit.client.0.smithi103.stdout: delete_pools_parallel: ******* SUCCESS ********** 2021-01-27T09:28:52.422 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: starting. 2021-01-27T09:28:52.422 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: creating pool ceph_test_rados_open_pools_parallel.smithi103-32733 2021-01-27T09:28:52.423 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: created object 0... 2021-01-27T09:28:52.423 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: created object 25... 2021-01-27T09:28:52.423 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: created object 49... 2021-01-27T09:28:52.423 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: finishing. 2021-01-27T09:28:52.423 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_1_[32746]: shutting down. 2021-01-27T09:28:52.424 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_2_[32747]: starting. 2021-01-27T09:28:52.424 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_2_[32747]: rados_pool_create. 2021-01-27T09:28:52.424 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_2_[32747]: rados_ioctx_create. 2021-01-27T09:28:52.424 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_2_[32747]: shutting down. 2021-01-27T09:28:52.425 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: ******************************* 2021-01-27T09:28:52.425 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: starting. 2021-01-27T09:28:52.425 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: creating pool ceph_test_rados_open_pools_parallel.smithi103-32733 2021-01-27T09:28:52.425 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: created object 0... 2021-01-27T09:28:52.426 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: created object 25... 2021-01-27T09:28:52.426 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: created object 49... 2021-01-27T09:28:52.427 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: finishing. 2021-01-27T09:28:52.427 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_3_[33187]: shutting down. 2021-01-27T09:28:52.427 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: ******************************* 2021-01-27T09:28:52.427 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_4_[33188]: starting. 2021-01-27T09:28:52.428 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_4_[33188]: rados_pool_create. 2021-01-27T09:28:52.428 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_4_[33188]: rados_ioctx_create. 2021-01-27T09:28:52.428 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: process_4_[33188]: shutting down. 2021-01-27T09:28:52.428 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: ******************************* 2021-01-27T09:28:52.428 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: ******************************* 2021-01-27T09:28:52.429 INFO:tasks.workunit.client.0.smithi103.stdout: open_pools_parallel: ******* SUCCESS ********** 2021-01-27T09:28:52.679 INFO:tasks.workunit.client.0.smithi103.stdout:mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:52.679 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.217510+0000 mon.a [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32212-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.679 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.218892+0000 mon.a [INF] from='client.? 172.21.15.103:0/2769118958' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:52.679 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.228240+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:52.680 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.229085+0000 mon.c [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:52.680 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.230188+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:52.680 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.230658+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32449-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.680 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.231252+0000 mon.c [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:52.681 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.231585+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:52.681 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.232276+0000 client.admin [INF] onexx 2021-01-27T09:28:52.681 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.232501+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-27T09:28:52.681 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.234698+0000 mon.c [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.681 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.235618+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32180-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.682 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.235916+0000 mon.c [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.682 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:49.236232+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32217-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:52.682 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:50.678315+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-27T09:28:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.585911+0000 osd.3 (osd.3) 3 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:28:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: cluster 2021-01-27T09:28:49.871073+0000 osd.5 (osd.5) 3 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:28:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: audit 2021-01-27T09:28:50.672594+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: audit 2021-01-27T09:28:50.678315+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-27T09:28:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: audit 2021-01-27T09:28:50.688150+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:52 smithi047 bash[9721]: audit 2021-01-27T09:28:51.129757+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:52.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.585911+0000 osd.3 (osd.3) 3 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:28:52.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: cluster 2021-01-27T09:28:49.871073+0000 osd.5 (osd.5) 3 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:28:52.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: audit 2021-01-27T09:28:50.672594+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:52.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: audit 2021-01-27T09:28:50.678315+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-27T09:28:52.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: audit 2021-01-27T09:28:50.688150+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:52.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[9772]: audit 2021-01-27T09:28:51.129757+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:52.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.585911+0000 osd.3 (osd.3) 3 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:28:52.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: cluster 2021-01-27T09:28:49.871073+0000 osd.5 (osd.5) 3 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:28:52.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: audit 2021-01-27T09:28:50.672594+0000 mon.a (mon.0) 765 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:52.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: audit 2021-01-27T09:28:50.678315+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-27T09:28:52.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: audit 2021-01-27T09:28:50.688150+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:52.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:52 smithi103 bash[13570]: audit 2021-01-27T09:28:51.129757+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.445 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:50.688150+0000 mon.a [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32466-7", "po0... 2021-01-27T09:28:53.445 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object 25... 2021-01-27T09:28:53.446 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object 50... 2021-01-27T09:28:53.446 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object 75... 2021-01-27T09:28:53.446 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object 100... 2021-01-27T09:28:53.446 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: listed object 125... 2021-01-27T09:28:53.446 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: saw 150 objects 2021-01-27T09:28:53.447 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_15_[33550]: shutting down. 2021-01-27T09:28:53.447 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.447 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.447 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.447 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: starting. 2021-01-27T09:28:53.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: added 25 objects... 2021-01-27T09:28:53.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: added half of the objects 2021-01-27T09:28:53.448 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: added 50 objects... 2021-01-27T09:28:53.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: added 50 objects 2021-01-27T09:28:53.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: process_16_[33551]: shutting down. 2021-01-27T09:28:53.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.449 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******************************* 2021-01-27T09:28:53.450 INFO:tasks.workunit.client.0.smithi103.stdout: list_parallel: ******* SUCCESS ********** 2021-01-27T09:28:53.475 INFO:tasks.workunit.client.0.smithi103.stdout:ol_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:53.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.129757+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.130224+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.132407+0000 mon.c [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.133186+0000 mon.c [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.157336+0000 mon.c [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.559086+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:53.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:51.560201+0000 mon.c [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.400096+0000 mon.c [INF] from='client.? 172.21.15.103:0/3304560537' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.415967+0000 mon.a [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:53.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.423015+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.423199+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.423454+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.423666+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.423974+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:50.344446+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v355: 652 pgs: 2 active+clean+snaptrim, 20 creating+activating, 50 creating+peering, 1 active+clean+snaptrim_wait, 101 unknown, 478 active+clean; 120 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 28 MiB/s wr, 555 op/s 2021-01-27T09:28:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.130224+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.132407+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.133186+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.156215+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-27T09:28:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.157336+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:51.234546+0000 osd.6 (osd.6) 3 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:28:53.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.559086+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:53.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:51.560201+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.194853+0000 osd.6 (osd.6) 4 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:28:53.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.346035+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v357: 588 pgs: 2 active+clean+snaptrim, 6 creating+activating, 36 creating+peering, 1 active+clean+snaptrim_wait, 107 unknown, 436 active+clean; 120 MiB data, 415 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 23 MiB/s wr, 459 op/s 2021-01-27T09:28:53.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.400096+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.103:0/3304560537' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.401116+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T09:28:53.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.408603+0000 mon.a (mon.0) 772 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.415967+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:53.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.423015+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.423199+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.423454+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.423666+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.423974+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.435040+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:53.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.435124+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:53.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.435209+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:53.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.435297+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:53.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.438069+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T09:28:53.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.611869+0000 osd.0 (osd.0) 4 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:28:53.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.680102+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.680508+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-27T09:28:53.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:52.897477+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: audit 2021-01-27T09:28:53.410911+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:53 smithi047 bash[9721]: cluster 2021-01-27T09:28:53.411797+0000 mon.a (mon.0) 786 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:50.344446+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v355: 652 pgs: 2 active+clean+snaptrim, 20 creating+activating, 50 creating+peering, 1 active+clean+snaptrim_wait, 101 unknown, 478 active+clean; 120 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 28 MiB/s wr, 555 op/s 2021-01-27T09:28:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.130224+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.132407+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.133186+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.156215+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-27T09:28:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.157336+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:51.234546+0000 osd.6 (osd.6) 3 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:28:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.559086+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:51.560201+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.194853+0000 osd.6 (osd.6) 4 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:28:53.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.346035+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v357: 588 pgs: 2 active+clean+snaptrim, 6 creating+activating, 36 creating+peering, 1 active+clean+snaptrim_wait, 107 unknown, 436 active+clean; 120 MiB data, 415 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 23 MiB/s wr, 459 op/s 2021-01-27T09:28:53.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.400096+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.103:0/3304560537' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.401116+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T09:28:53.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.408603+0000 mon.a (mon.0) 772 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.415967+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:53.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.423015+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.423199+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.423454+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.423666+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.423974+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.435040+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:53.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.435124+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:53.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.435209+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:53.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.435297+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:53.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.438069+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T09:28:53.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.611869+0000 osd.0 (osd.0) 4 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:28:53.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.680102+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.680508+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-27T09:28:53.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:52.897477+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: audit 2021-01-27T09:28:53.410911+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[13570]: cluster 2021-01-27T09:28:53.411797+0000 mon.a (mon.0) 786 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:53.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:50.344446+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v355: 652 pgs: 2 active+clean+snaptrim, 20 creating+activating, 50 creating+peering, 1 active+clean+snaptrim_wait, 101 unknown, 478 active+clean; 120 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 28 MiB/s wr, 555 op/s 2021-01-27T09:28:53.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.130224+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:53.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.132407+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.133186+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.156215+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-27T09:28:53.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.157336+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:51.234546+0000 osd.6 (osd.6) 3 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:28:53.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.559086+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:53.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:51.560201+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.103:0/1416067651' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.194853+0000 osd.6 (osd.6) 4 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:28:53.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.346035+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v357: 588 pgs: 2 active+clean+snaptrim, 6 creating+activating, 36 creating+peering, 1 active+clean+snaptrim_wait, 107 unknown, 436 active+clean; 120 MiB data, 415 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 23 MiB/s wr, 459 op/s 2021-01-27T09:28:53.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.400096+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.103:0/3304560537' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.401116+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T09:28:53.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.408603+0000 mon.a (mon.0) 772 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.415967+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:53.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.423015+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.423199+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:53.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.423454+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.423666+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]: dispatch 2021-01-27T09:28:53.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.423974+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:53.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.435040+0000 mon.a (mon.0) 779 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:53.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.435124+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:53.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.435209+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:53.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.435297+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:53.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.438069+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T09:28:53.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.611869+0000 osd.0 (osd.0) 4 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:28:53.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.680102+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.680508+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-27T09:28:53.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:52.897477+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:53.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: audit 2021-01-27T09:28:53.410911+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:53.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:53 smithi103 bash[9772]: cluster 2021-01-27T09:28:53.411797+0000 mon.a (mon.0) 786 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:54.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[10018]: debug 2021-01-27T09:28:54.091+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:28:54.460 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.435040+0000 mon.a [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32212-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32212-10"ibRadosIoECPP.OverlappingWriteRoundTripPP 2021-01-27T09:28:54.460 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (6 ms) 2021-01-27T09:28:54.460 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2021-01-27T09:28:54.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (8 ms) 2021-01-27T09:28:54.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2021-01-27T09:28:54.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (5 ms) 2021-01-27T09:28:54.461 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2021-01-27T09:28:54.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (11 ms) 2021-01-27T09:28:54.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2021-01-27T09:28:54.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (11 ms) 2021-01-27T09:28:54.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2021-01-27T09:28:54.462 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (7 ms) 2021-01-27T09:28:54.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2021-01-27T09:28:54.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (10 ms) 2021-01-27T09:28:54.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2021-01-27T09:28:54.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (19 ms) 2021-01-27T09:28:54.463 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2021-01-27T09:28:54.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (12 ms) 2021-01-27T09:28:54.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2021-01-27T09:28:54.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (13 ms) 2021-01-27T09:28:54.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2021-01-27T09:28:54.464 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (6 ms) 2021-01-27T09:28:54.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2021-01-27T09:28:54.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (10 ms) 2021-01-27T09:28:54.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1787 ms total) 2021-01-27T09:28:54.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: 2021-01-27T09:28:54.465 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [----------] Global test environment tear-down 2021-01-27T09:28:54.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (21489 ms total) 2021-01-27T09:28:54.466 INFO:tasks.workunit.client.0.smithi103.stdout: api_io_pp: [ PASSED ] 37 tests. 2021-01-27T09:28:54.483 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:28:54.483 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: cluster 2021-01-27T09:28:52.867815+0000 osd.5 (osd.5) 4 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:28:54.484 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.435366+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.484 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.435759+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.484 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.435923+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.484 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.436099+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.485 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.436285+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:54.485 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.436487+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.485 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: cluster 2021-01-27T09:28:53.436885+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T09:28:54.485 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.436960+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.486 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.440891+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.486 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.441339+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2"}]: dispatch 2021-01-27T09:28:54.486 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.442787+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.486 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.443530+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:54.486 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.444321+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.448421+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.448740+0000 mon.a (mon.0) 797 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.449012+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.451929+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.487 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.475694+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-27T09:28:54.488 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.485662+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.488 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: cluster 2021-01-27T09:28:53.486406+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-27T09:28:54.488 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:53.487423+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.488 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.096408+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:54.489 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.412857+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:54.489 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.444583+0000 mon.a (mon.0) 803 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.489 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.444773+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.489 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.444943+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-27T09:28:54.489 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.445068+0000 mon.a (mon.0) 806 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.445166+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.445335+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: cluster 2021-01-27T09:28:54.446228+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T09:28:54.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.448971+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.451975+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.452504+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.453757+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.454941+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:54.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.458256+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:54.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.458420+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.458758+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:54 smithi047 bash[9721]: audit 2021-01-27T09:28:54.469716+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:54.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: cluster 2021-01-27T09:28:52.867815+0000 osd.5 (osd.5) 4 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:28:54.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.435366+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.435759+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.435923+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.436099+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.436285+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:54.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.436487+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: cluster 2021-01-27T09:28:53.436885+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T09:28:54.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.436960+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.440891+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.441339+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2"}]: dispatch 2021-01-27T09:28:54.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.442787+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.443530+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:54.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.444321+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.448421+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.448740+0000 mon.a (mon.0) 797 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.449012+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.451929+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.475694+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-27T09:28:54.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.485662+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: cluster 2021-01-27T09:28:53.486406+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-27T09:28:54.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:53.487423+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.096408+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:54.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.412857+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:54.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.444583+0000 mon.a (mon.0) 803 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.444773+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.444943+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-27T09:28:54.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.445068+0000 mon.a (mon.0) 806 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.445166+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.445335+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: cluster 2021-01-27T09:28:54.446228+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T09:28:54.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.448971+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.451975+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.452504+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.453757+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.454941+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:54.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.458256+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:54.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.458420+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.458758+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[13570]: audit 2021-01-27T09:28:54.469716+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:54.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: cluster 2021-01-27T09:28:52.867815+0000 osd.5 (osd.5) 4 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:28:54.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.435366+0000 mon.a (mon.0) 787 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.435759+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.435923+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.436099+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.436285+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32520-1"}]': finished 2021-01-27T09:28:54.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.436487+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: cluster 2021-01-27T09:28:53.436885+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T09:28:54.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.436960+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.440891+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.103:0/3255953440' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.441339+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2"}]: dispatch 2021-01-27T09:28:54.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.442787+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.443530+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]: dispatch 2021-01-27T09:28:54.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.444321+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:54.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.448421+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-27T09:28:54.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.448740+0000 mon.a (mon.0) 797 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.449012+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.451929+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.475694+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-27T09:28:54.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.485662+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: cluster 2021-01-27T09:28:53.486406+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-27T09:28:54.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:53.487423+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-27T09:28:54.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.096408+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:28:54.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.412857+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:54.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.444583+0000 mon.a (mon.0) 803 : audit [INF] from='client.? 172.21.15.103:0/338688477' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32186-22"}]': finished 2021-01-27T09:28:54.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.444773+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-4", "overlaypool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:54.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.444943+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi103-32172-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-27T09:28:54.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.445068+0000 mon.a (mon.0) 806 : audit [INF] from='client.? 172.21.15.103:0/3180033177' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.445166+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32264-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.445335+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.103:0/2190443901' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:54.911 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: cluster 2021-01-27T09:28:54.446228+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T09:28:54.911 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.448971+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.912 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.451975+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.912 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.452504+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.912 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.453757+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]: dispatch 2021-01-27T09:28:54.912 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.454941+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:54.913 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.458256+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:54.913 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.458420+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:54.913 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.458758+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:54.913 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:54 smithi103 bash[9772]: audit 2021-01-27T09:28:54.469716+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: cluster 2021-01-27T09:28:54.347310+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 652 pgs: 80 creating+peering, 110 unknown, 462 active+clean; 144 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 2 op/s 2021-01-27T09:28:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.471792+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-27T09:28:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.473987+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.484392+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-27T09:28:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.491168+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.540804+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: cluster 2021-01-27T09:28:54.945484+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:28:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.958573+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]': finished 2021-01-27T09:28:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.958771+0000 mon.a (mon.0) 819 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.958884+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.959000+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.959267+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.959457+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:28:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: cluster 2021-01-27T09:28:54.960469+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T09:28:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.964195+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.966507+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.103:0/4224090895' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.966927+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.967172+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.969875+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.972514+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.979116+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.981503+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.981952+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.983795+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.984413+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.985763+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.987161+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:54.988610+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:55.015376+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:55.015690+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:55.019389+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:55.453620+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:55 smithi047 bash[9721]: audit 2021-01-27T09:28:55.454277+0000 mon.a (mon.0) 835 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:55.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: cluster 2021-01-27T09:28:54.347310+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 652 pgs: 80 creating+peering, 110 unknown, 462 active+clean; 144 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 2 op/s 2021-01-27T09:28:55.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.471792+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-27T09:28:55.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.473987+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.484392+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-27T09:28:55.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.491168+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.540804+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: cluster 2021-01-27T09:28:54.945484+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:28:55.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.958573+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]': finished 2021-01-27T09:28:55.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.958771+0000 mon.a (mon.0) 819 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:55.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.958884+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:55.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.959000+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:55.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.959267+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:55.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.959457+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:28:55.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: cluster 2021-01-27T09:28:54.960469+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T09:28:55.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.964195+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.966507+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.103:0/4224090895' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.966927+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.967172+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.969875+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:55.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.972514+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.979116+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.981503+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.981952+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.983795+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.984413+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.985763+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.987161+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:54.988610+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:55.015376+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:55.015690+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:55.019389+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:55.453620+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[13570]: audit 2021-01-27T09:28:55.454277+0000 mon.a (mon.0) 835 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:55.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: cluster 2021-01-27T09:28:54.347310+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 652 pgs: 80 creating+peering, 110 unknown, 462 active+clean; 144 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 2 op/s 2021-01-27T09:28:55.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.471792+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-27T09:28:55.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.473987+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.484392+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-27T09:28:55.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.491168+0000 mon.a (mon.0) 816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:28:55.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.540804+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: cluster 2021-01-27T09:28:54.945484+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:28:55.903 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.958573+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-4-cache", "mode": "writeback"}]': finished 2021-01-27T09:28:55.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.958771+0000 mon.a (mon.0) 819 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:55.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.958884+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32520-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:55.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.959000+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:55.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.959267+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:55.904 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.959457+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:28:55.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: cluster 2021-01-27T09:28:54.960469+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T09:28:55.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.964195+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.103:0/2655475034' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.966507+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.103:0/4224090895' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.905 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.966927+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.967172+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.103:0/1724135509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.969875+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]: dispatch 2021-01-27T09:28:55.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.972514+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.979116+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.981503+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]: dispatch 2021-01-27T09:28:55.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.981952+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:55.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.983795+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:28:55.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.984413+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]: dispatch 2021-01-27T09:28:55.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.985763+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:55.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.987161+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:54.988610+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:28:55.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:55.015376+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:55.015690+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]: dispatch 2021-01-27T09:28:55.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:55.019389+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:55.453620+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]: dispatch 2021-01-27T09:28:55.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:55 smithi103 bash[9772]: audit 2021-01-27T09:28:55.454277+0000 mon.a (mon.0) 835 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:55.973 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: Running main() from gmock_main.cc 2021-01-27T09:28:55.974 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [==========] Running 23 tests from 2 test suites. 2021-01-27T09:28:55.974 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] Global test environment set-up. 2021-01-27T09:28:55.974 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] 13 tests from LibRadosIo 2021-01-27T09:28:55.975 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2021-01-27T09:28:55.975 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (374 ms) 2021-01-27T09:28:55.975 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2021-01-27T09:28:55.975 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2021-01-27T09:28:55.975 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2021-01-27T09:28:55.976 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: no timeout :/ 2021-01-27T09:28:55.976 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: no timeout :/ 2021-01-27T09:28:55.976 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: no timeout :/ 2021-01-27T09:28:55.976 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: no timeout :/ 2021-01-27T09:28:55.976 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: no timeout :/ 2021-01-27T09:28:55.977 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (208 ms) 2021-01-27T09:28:55.977 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2021-01-27T09:28:55.977 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (11 ms) 2021-01-27T09:28:55.977 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2021-01-27T09:28:55.978 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.Checksum (3 ms) 2021-01-27T09:28:55.978 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2021-01-27T09:28:55.978 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (9 ms) 2021-01-27T09:28:55.978 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2021-01-27T09:28:55.979 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (7 ms) 2021-01-27T09:28:55.979 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2021-01-27T09:28:55.979 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (7 ms) 2021-01-27T09:28:55.980 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2021-01-27T09:28:55.980 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.TruncTest (4 ms) 2021-01-27T09:28:55.980 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2021-01-27T09:28:55.981 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2021-01-27T09:28:55.981 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2021-01-27T09:28:55.981 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (4 ms) 2021-01-27T09:28:55.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2021-01-27T09:28:55.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.RmXattr (15 ms) 2021-01-27T09:28:55.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2021-01-27T09:28:55.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIo.XattrIter (6 ms) 2021-01-27T09:28:55.982 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] 13 tests from LibRadosIo (652 ms total) 2021-01-27T09:28:55.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: 2021-01-27T09:28:55.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2021-01-27T09:28:55.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2021-01-27T09:28:55.983 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1117 ms) 2021-01-27T09:28:55.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2021-01-27T09:28:55.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (10 ms) 2021-01-27T09:28:55.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2021-01-27T09:28:55.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (6 ms) 2021-01-27T09:28:55.984 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2021-01-27T09:28:55.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (7 ms) 2021-01-27T09:28:55.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2021-01-27T09:28:55.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (10 ms) 2021-01-27T09:28:55.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2021-01-27T09:28:55.985 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (6 ms) 2021-01-27T09:28:55.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2021-01-27T09:28:55.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (5 ms) 2021-01-27T09:28:55.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2021-01-27T09:28:55.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (7 ms) 2021-01-27T09:28:55.986 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2021-01-27T09:28:55.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (20 ms) 2021-01-27T09:28:55.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2021-01-27T09:28:55.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (8 ms) 2021-01-27T09:28:55.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1196 ms total) 2021-01-27T09:28:55.987 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: 2021-01-27T09:28:55.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [----------] Global test environment tear-down 2021-01-27T09:28:55.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [==========] 23 tests from 2 test suites ran. (23008 ms total) 2021-01-27T09:28:55.988 INFO:tasks.workunit.client.0.smithi103.stdout: api_io: [ PASSED ] 23 tests. 2021-01-27T09:28:55.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: Running main() from gmock_main.cc 2021-01-27T09:28:55.989 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2021-01-27T09:28:55.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] Global test environment set-up. 2021-01-27T09:28:55.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2021-01-27T09:28:55.990 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: seed 32466 2021-01-27T09:28:55.991 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2021-01-27T09:28:55.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (441 ms) 2021-01-27T09:28:55.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2021-01-27T09:28:55.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (7 ms) 2021-01-27T09:28:55.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2021-01-27T09:28:55.992 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2021-01-27T09:28:55.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2021-01-27T09:28:55.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (4 ms) 2021-01-27T09:28:55.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2021-01-27T09:28:55.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (14 ms) 2021-01-27T09:28:55.993 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (466 ms total) 2021-01-27T09:28:55.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: 2021-01-27T09:28:55.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2021-01-27T09:28:55.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2021-01-27T09:28:55.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1134 ms) 2021-01-27T09:28:55.994 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2021-01-27T09:28:55.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (384 ms) 2021-01-27T09:28:55.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2021-01-27T09:28:55.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (6 ms) 2021-01-27T09:28:55.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2021-01-27T09:28:55.995 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (15 ms) 2021-01-27T09:28:55.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1539 ms total) 2021-01-27T09:28:55.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: 2021-01-27T09:28:55.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [----------] Global test environment tear-down 2021-01-27T09:28:55.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (22891 ms total) 2021-01-27T09:28:55.996 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat_pp: [ PASSED ] 9 tests. 2021-01-27T09:28:55.997 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: Running main() from gmock_main.cc 2021-01-27T09:28:55.997 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2021-01-27T09:28:55.997 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] Global test environment set-up. 2021-01-27T09:28:55.997 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] 4 tests from LibRadosStat 2021-01-27T09:28:55.997 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2021-01-27T09:28:55.998 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStat.Stat (335 ms) 2021-01-27T09:28:55.998 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2021-01-27T09:28:55.998 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStat.StatNS (103 ms) 2021-01-27T09:28:55.998 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2021-01-27T09:28:55.999 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2021-01-27T09:28:55.999 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2021-01-27T09:28:55.999 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (4 ms) 2021-01-27T09:28:55.999 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] 4 tests from LibRadosStat (443 ms total) 2021-01-27T09:28:55.999 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: 2021-01-27T09:28:56.000 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2021-01-27T09:28:56.000 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2021-01-27T09:28:56.000 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1121 ms) 2021-01-27T09:28:56.000 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2021-01-27T09:28:56.000 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (14 ms) 2021-01-27T09:28:56.001 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2021-01-27T09:28:56.001 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2021-01-27T09:28:56.001 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2021-01-27T09:28:56.001 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (3 ms) 2021-01-27T09:28:56.001 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1138 ms total) 2021-01-27T09:28:56.002 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: 2021-01-27T09:28:56.002 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [----------] Global test environment tear-down 2021-01-27T09:28:56.002 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (22914 ms total) 2021-01-27T09:28:56.002 INFO:tasks.workunit.client.0.smithi103.stdout: api_stat: [ PASSED ] 8 tests. 2021-01-27T09:28:56.491 INFO:tasks.workunit.client.0.smithi103.stdout:}]': finished 2021-01-27T09:28:56.491 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.435124+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32449-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:56.492 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.435209+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32180-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:56.492 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.435297+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32217-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:56.492 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.680102+0000 mon.c [INF] from='client.? 172.21.15.103:0/1095239733' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:56.492 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.680508+0000 client.admin [INF] threexx 2021-01-27T09:28:56.493 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:52.897477+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-27T09:28:56.493 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: got: 2021-01-27T09:28:53.411797+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:28:56.493 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8157 ms) 2021-01-27T09:28:56.493 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (23386 ms total) 2021-01-27T09:28:56.493 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: 2021-01-27T09:28:56.494 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [----------] Global test environment tear-down 2021-01-27T09:28:56.494 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (23386 ms total) 2021-01-27T09:28:56.494 INFO:tasks.workunit.client.0.smithi103.stdout: api_cmd: [ PASSED ] 4 tests. 2021-01-27T09:28:57.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.959913+0000 mon.a (mon.0) 836 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.960258+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.960511+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.960732+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:28:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.960954+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.961473+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.961928+0000 mon.a (mon.0) 842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]': finished 2021-01-27T09:28:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.962015+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]': finished 2021-01-27T09:28:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: cluster 2021-01-27T09:28:55.962152+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T09:28:57.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.967369+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.971206+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.972088+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.972576+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.973186+0000 mon.a (mon.0) 845 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:57.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.973609+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.977177+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.977668+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.978302+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.978823+0000 mon.a (mon.0) 849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:55.979303+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:57 smithi047 bash[9721]: audit 2021-01-27T09:28:56.467119+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:57.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.959913+0000 mon.a (mon.0) 836 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:57.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.960258+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:57.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.960511+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:57.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.960732+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:28:57.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.960954+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:57.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.961473+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:57.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.961928+0000 mon.a (mon.0) 842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]': finished 2021-01-27T09:28:57.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.962015+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]': finished 2021-01-27T09:28:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: cluster 2021-01-27T09:28:55.962152+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T09:28:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.967369+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.971206+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.972088+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.972576+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.973186+0000 mon.a (mon.0) 845 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:57.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.973609+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.977177+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.977668+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.978302+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.978823+0000 mon.a (mon.0) 849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:55.979303+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[13570]: audit 2021-01-27T09:28:56.467119+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:57.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.959913+0000 mon.a (mon.0) 836 : audit [INF] from='client.? 172.21.15.103:0/1043927865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32466-7"}]': finished 2021-01-27T09:28:57.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.960258+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32180-15"}]': finished 2021-01-27T09:28:57.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.960511+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:57.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.960732+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:28:57.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.960954+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32449-6"}]': finished 2021-01-27T09:28:57.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.961473+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32473-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:28:57.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.961928+0000 mon.a (mon.0) 842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32520-6", "pg_num": 4}]': finished 2021-01-27T09:28:57.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.962015+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-4"}]': finished 2021-01-27T09:28:57.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: cluster 2021-01-27T09:28:55.962152+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T09:28:57.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.967369+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.103:0/1366334302' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.971206+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.972088+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.972576+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.103:0/2084841342' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.973186+0000 mon.a (mon.0) 845 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:57.914 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.973609+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.977177+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:28:57.918 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.977668+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:28:57.918 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.978302+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:28:57.918 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.978823+0000 mon.a (mon.0) 849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]: dispatch 2021-01-27T09:28:57.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:55.979303+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:57.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:57 smithi103 bash[9772]: audit 2021-01-27T09:28:56.467119+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:58.010 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: Running main() from gmock_main.cc 2021-01-27T09:28:58.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2021-01-27T09:28:58.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] Global test environment set-up. 2021-01-27T09:28:58.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] 8 tests from LibRadosLock 2021-01-27T09:28:58.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2021-01-27T09:28:58.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (333 ms) 2021-01-27T09:28:58.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2021-01-27T09:28:58.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.LockShared (33 ms) 2021-01-27T09:28:58.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2021-01-27T09:28:58.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1049 ms) 2021-01-27T09:28:58.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2021-01-27T09:28:58.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1010 ms) 2021-01-27T09:28:58.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2021-01-27T09:28:58.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (11 ms) 2021-01-27T09:28:58.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2021-01-27T09:28:58.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.Unlock (8 ms) 2021-01-27T09:28:58.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2021-01-27T09:28:58.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (13 ms) 2021-01-27T09:28:58.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2021-01-27T09:28:58.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (7 ms) 2021-01-27T09:28:58.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] 8 tests from LibRadosLock (2464 ms total) 2021-01-27T09:28:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: 2021-01-27T09:28:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2021-01-27T09:28:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2021-01-27T09:28:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1096 ms) 2021-01-27T09:28:58.016 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2021-01-27T09:28:58.019 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (12 ms) 2021-01-27T09:28:58.029 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2021-01-27T09:28:58.030 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1112 ms) 2021-01-27T09:28:58.030 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2021-01-27T09:28:58.030 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1012 ms) 2021-01-27T09:28:58.030 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2021-01-27T09:28:58.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (13 ms) 2021-01-27T09:28:58.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2021-01-27T09:28:58.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (7 ms) 2021-01-27T09:28:58.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2021-01-27T09:28:58.032 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (9 ms) 2021-01-27T09:28:58.032 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2021-01-27T09:28:58.032 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (6 ms) 2021-01-27T09:28:58.033 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3267 ms total) 2021-01-27T09:28:58.033 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: 2021-01-27T09:28:58.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [----------] Global test environment tear-down 2021-01-27T09:28:58.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (25025 ms total) 2021-01-27T09:28:58.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock: [ PASSED ] 16 tests. 2021-01-27T09:28:58.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: Running main() from gmock_main.cc 2021-01-27T09:28:58.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2021-01-27T09:28:58.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] Global test environment set-up. 2021-01-27T09:28:58.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2021-01-27T09:28:58.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: seed 32217 2021-01-27T09:28:58.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2021-01-27T09:28:58.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (426 ms) 2021-01-27T09:28:58.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2021-01-27T09:28:58.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (24 ms) 2021-01-27T09:28:58.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2021-01-27T09:28:58.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1009 ms) 2021-01-27T09:28:58.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2021-01-27T09:28:58.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1010 ms) 2021-01-27T09:28:58.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2021-01-27T09:28:58.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (7 ms) 2021-01-27T09:28:58.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2021-01-27T09:28:58.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (7 ms) 2021-01-27T09:28:58.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2021-01-27T09:28:58.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (9 ms) 2021-01-27T09:28:58.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2021-01-27T09:28:58.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (7 ms) 2021-01-27T09:28:58.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2499 ms total) 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1112 ms) 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2021-01-27T09:28:58.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (13 ms) 2021-01-27T09:28:58.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2021-01-27T09:28:58.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1114 ms) 2021-01-27T09:28:58.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2021-01-27T09:28:58.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1011 ms) 2021-01-27T09:28:58.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2021-01-27T09:28:58.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (10 ms) 2021-01-27T09:28:58.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2021-01-27T09:28:58.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (9 ms) 2021-01-27T09:28:58.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2021-01-27T09:28:58.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (10 ms) 2021-01-27T09:28:58.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2021-01-27T09:28:58.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (4 ms) 2021-01-27T09:28:58.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3283 ms total) 2021-01-27T09:28:58.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: 2021-01-27T09:28:58.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [----------] Global test environment tear-down 2021-01-27T09:28:58.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (25044 ms total) 2021-01-27T09:28:58.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_lock_pp: [ PASSED ] 16 tests. 2021-01-27T09:28:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: cluster 2021-01-27T09:28:56.347948+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 552 pgs: 24 creating+peering, 63 unknown, 465 active+clean; 144 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:28:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: cluster 2021-01-27T09:28:56.956651+0000 mon.a (mon.0) 852 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:28:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:56.967368+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:56.967489+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:28:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.454550+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:28:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.454739+0000 mon.a (mon.0) 856 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.454863+0000 mon.a (mon.0) 857 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: cluster 2021-01-27T09:28:57.455225+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T09:28:58.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.455617+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:58.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.455913+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:58.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.458796+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:58.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.462652+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.467298+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:58.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.468218+0000 mon.a (mon.0) 862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:58.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.470301+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.103:0/591362367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.480711+0000 mon.a (mon.0) 863 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:58.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.481227+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.986924+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:28:58.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.987026+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:58.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.987150+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:58.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.987304+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:28:58.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.987392+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:58.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.987517+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:58.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: cluster 2021-01-27T09:28:57.987631+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T09:28:58.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.991493+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:58.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[9772]: audit 2021-01-27T09:28:57.992861+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:58.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: cluster 2021-01-27T09:28:56.347948+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 552 pgs: 24 creating+peering, 63 unknown, 465 active+clean; 144 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:28:58.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: cluster 2021-01-27T09:28:56.956651+0000 mon.a (mon.0) 852 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:28:58.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:56.967368+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:58.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:56.967489+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:28:58.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.454550+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:28:58.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.454739+0000 mon.a (mon.0) 856 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:58.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.454863+0000 mon.a (mon.0) 857 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:58.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: cluster 2021-01-27T09:28:57.455225+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T09:28:58.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.455617+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:58.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.455913+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:58.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.458796+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:58.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.462652+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.467298+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:58.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.468218+0000 mon.a (mon.0) 862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:58.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.470301+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.103:0/591362367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.480711+0000 mon.a (mon.0) 863 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:58.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.481227+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:58.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.986924+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:28:58.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.987026+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:58.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.987150+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:58.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.987304+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:28:58.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.987392+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:58.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.987517+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:58.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: cluster 2021-01-27T09:28:57.987631+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T09:28:58.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.991493+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:58.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:28:58 smithi103 bash[13570]: audit 2021-01-27T09:28:57.992861+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: cluster 2021-01-27T09:28:56.347948+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 552 pgs: 24 creating+peering, 63 unknown, 465 active+clean; 144 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:28:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: cluster 2021-01-27T09:28:56.956651+0000 mon.a (mon.0) 852 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:28:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:56.967368+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:56.967489+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32264-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:28:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.454550+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:28:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.454739+0000 mon.a (mon.0) 856 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-4", "tierpool": "test-rados-api-smithi103-32354-4-cache"}]': finished 2021-01-27T09:28:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.454863+0000 mon.a (mon.0) 857 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: cluster 2021-01-27T09:28:57.455225+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T09:28:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.455617+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.455913+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.103:0/3565183024' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.458796+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]: dispatch 2021-01-27T09:28:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.462652+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.467298+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:28:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.468218+0000 mon.a (mon.0) 862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]: dispatch 2021-01-27T09:28:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.470301+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.103:0/591362367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.480711+0000 mon.a (mon.0) 863 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:28:59.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.481227+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:28:59.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.986924+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32473-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:28:59.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.987026+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.103:0/1114015850' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32212-10"}]': finished 2021-01-27T09:28:59.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.987150+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.103:0/151818990' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:59.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.987304+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32520-4", "overlaypool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:28:59.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.987392+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32217-10"}]': finished 2021-01-27T09:28:59.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.987517+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:28:59.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: cluster 2021-01-27T09:28:57.987631+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T09:28:59.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.991493+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:59.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:28:58 smithi047 bash[9721]: audit 2021-01-27T09:28:57.992861+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]: dispatch 2021-01-27T09:28:59.235 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [==========] Running 3 tests from 1 test suite. 2021-01-27T09:28:59.235 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [----------] Global test environment set-up. 2021-01-27T09:28:59.235 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [----------] 3 tests from LibRadosService 2021-01-27T09:28:59.236 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2021-01-27T09:28:59.236 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5033 ms) 2021-01-27T09:28:59.236 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2021-01-27T09:28:59.236 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ OK ] LibRadosService.RegisterLate (26 ms) 2021-01-27T09:28:59.237 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ RUN ] LibRadosService.Status 2021-01-27T09:28:59.237 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ OK ] LibRadosService.Status (21027 ms) 2021-01-27T09:28:59.237 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [----------] 3 tests from LibRadosService (26087 ms total) 2021-01-27T09:28:59.237 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: 2021-01-27T09:28:59.237 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [----------] Global test environment tear-down 2021-01-27T09:28:59.238 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [==========] 3 tests from 1 test suite ran. (26087 ms total) 2021-01-27T09:28:59.238 INFO:tasks.workunit.client.0.smithi103.stdout: api_service: [ PASSED ] 3 tests. 2021-01-27T09:29:00.801 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[12576]: debug 2021-01-27T09:29:00.545+0000 7f173eb47700 -1 osd.4 pg_epoch: 79 pg[15.3( v 78'4 (0'0,78'4] local-lis/les=62/64 n=2 ec=62/62 lis/c=62/62 les/c/f=64/64/0 sis=62) [4,6,3] r=0 lpr=62 crt=78'4 lcod 77'3 mlcod 77'3 active+clean+snaptrim trimq=[9~1] ps=[3~1,5~1,7~1]] removing snap head 2021-01-27T09:29:00.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: audit 2021-01-27T09:28:58.621090+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:00.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: audit 2021-01-27T09:28:58.670243+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:29:00.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: audit 2021-01-27T09:28:58.677462+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:29:00.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: cluster 2021-01-27T09:28:58.727931+0000 osd.0 (osd.0) 5 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:00.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: cluster 2021-01-27T09:28:58.983142+0000 mon.a (mon.0) 876 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:00.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: audit 2021-01-27T09:28:58.995499+0000 mon.a (mon.0) 877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]': finished 2021-01-27T09:29:00.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: cluster 2021-01-27T09:28:58.995793+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T09:29:00.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:00 smithi047 bash[9721]: audit 2021-01-27T09:28:59.015563+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:00.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: audit 2021-01-27T09:28:58.621090+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:00.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: audit 2021-01-27T09:28:58.670243+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:29:00.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: audit 2021-01-27T09:28:58.677462+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:29:00.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: cluster 2021-01-27T09:28:58.727931+0000 osd.0 (osd.0) 5 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: cluster 2021-01-27T09:28:58.983142+0000 mon.a (mon.0) 876 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: audit 2021-01-27T09:28:58.995499+0000 mon.a (mon.0) 877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]': finished 2021-01-27T09:29:00.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: cluster 2021-01-27T09:28:58.995793+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T09:29:00.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[9772]: audit 2021-01-27T09:28:59.015563+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:00.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: audit 2021-01-27T09:28:58.621090+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:00.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: audit 2021-01-27T09:28:58.670243+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:29:00.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: audit 2021-01-27T09:28:58.677462+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:29:00.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: cluster 2021-01-27T09:28:58.727931+0000 osd.0 (osd.0) 5 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:00.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: cluster 2021-01-27T09:28:58.983142+0000 mon.a (mon.0) 876 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:00.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: audit 2021-01-27T09:28:58.995499+0000 mon.a (mon.0) 877 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32520-6", "mode": "writeback"}]': finished 2021-01-27T09:29:00.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: cluster 2021-01-27T09:28:58.995793+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T09:29:00.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:00 smithi103 bash[13570]: audit 2021-01-27T09:28:59.015563+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: cluster 2021-01-27T09:28:58.348626+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 560 pgs: 19 creating+peering, 122 unknown, 419 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:29:02.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: cluster 2021-01-27T09:28:59.765181+0000 osd.0 (osd.0) 6 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:02.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: cluster 2021-01-27T09:29:00.349869+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v369: 464 pgs: 19 creating+peering, 20 unknown, 425 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2021-01-27T09:29:02.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: cluster 2021-01-27T09:29:00.497535+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:02.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:00.500959+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:02.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:00.526715+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:02.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:00.540731+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:00.541974+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.103:0/799984996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: cluster 2021-01-27T09:29:01.189359+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T09:29:02.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:01.210630+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:01.245118+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:01 smithi047 bash[9721]: audit 2021-01-27T09:29:01.245885+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: cluster 2021-01-27T09:28:58.348626+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 560 pgs: 19 creating+peering, 122 unknown, 419 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:29:02.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: cluster 2021-01-27T09:28:59.765181+0000 osd.0 (osd.0) 6 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: cluster 2021-01-27T09:29:00.349869+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v369: 464 pgs: 19 creating+peering, 20 unknown, 425 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2021-01-27T09:29:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: cluster 2021-01-27T09:29:00.497535+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:00.500959+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:00.526715+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:00.540731+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:00.541974+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.103:0/799984996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: cluster 2021-01-27T09:29:01.189359+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T09:29:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:01.210630+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:01.245118+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[9772]: audit 2021-01-27T09:29:01.245885+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: cluster 2021-01-27T09:28:58.348626+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 560 pgs: 19 creating+peering, 122 unknown, 419 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-27T09:29:02.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: cluster 2021-01-27T09:28:59.765181+0000 osd.0 (osd.0) 6 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:02.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: cluster 2021-01-27T09:29:00.349869+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v369: 464 pgs: 19 creating+peering, 20 unknown, 425 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2021-01-27T09:29:02.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: cluster 2021-01-27T09:29:00.497535+0000 mon.a (mon.0) 880 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:00.500959+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:00.526715+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.103:0/1303334502' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32389-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:00.540731+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:00.541974+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.103:0/799984996' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: cluster 2021-01-27T09:29:01.189359+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T09:29:02.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:01.210630+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:02.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:01.245118+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:01 smithi103 bash[13570]: audit 2021-01-27T09:29:01.245885+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:02.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2021-01-27T09:29:02.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2021-01-27T09:29:02.476 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2021-01-27T09:29:02.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2021-01-27T09:29:02.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2021-01-27T09:29:02.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify 2021-01-27T09:29:02.477 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (2517 ms) 2021-01-27T09:29:02.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2021-01-27T09:29:02.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (32 ms) 2021-01-27T09:29:02.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (2549 ms total) 2021-01-27T09:29:02.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: 2021-01-27T09:29:02.478 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2021-01-27T09:29:02.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2021-01-27T09:29:02.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify 2021-01-27T09:29:02.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (45 ms) 2021-01-27T09:29:02.479 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2021-01-27T09:29:02.480 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify 2021-01-27T09:29:02.480 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4095 ms) 2021-01-27T09:29:02.480 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2021-01-27T09:29:02.480 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (84 ms) 2021-01-27T09:29:02.481 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2021-01-27T09:29:02.481 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (27 ms) 2021-01-27T09:29:02.481 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2021-01-27T09:29:02.481 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978952176 notify_id 335007449089 notifier_gid 25090 2021-01-27T09:29:02.482 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (36 ms) 2021-01-27T09:29:02.482 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2021-01-27T09:29:02.482 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978952176 notify_id 335007449090 notifier_gid 25090 2021-01-27T09:29:02.482 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (54 ms) 2021-01-27T09:29:02.483 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2021-01-27T09:29:02.483 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978952176 notify_id 335007449091 notifier_gid 25090 2021-01-27T09:29:02.483 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (51 ms) 2021-01-27T09:29:02.483 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2021-01-27T09:29:02.483 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978970352 notify_id 335007449088 notifier_gid 25090 2021-01-27T09:29:02.484 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (45 ms) 2021-01-27T09:29:02.484 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2021-01-27T09:29:02.484 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978970352 notify_id 335007449090 notifier_gid 25090 2021-01-27T09:29:02.484 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (26 ms) 2021-01-27T09:29:02.485 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2021-01-27T09:29:02.485 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978985040 notify_id 335007449089 notifier_gid 25090 2021-01-27T09:29:02.485 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (24 ms) 2021-01-27T09:29:02.485 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2021-01-27T09:29:02.485 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: trying... 2021-01-27T09:29:02.486 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978985040 notify_id 335007449092 notifier_gid 25090 2021-01-27T09:29:02.486 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: timed out 2021-01-27T09:29:02.486 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: flushing 2021-01-27T09:29:03.004 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: Running main() from gmock_main.cc 2021-01-27T09:29:03.005 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2021-01-27T09:29:03.005 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] Global test environment set-up. 2021-01-27T09:29:03.005 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2021-01-27T09:29:03.005 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2021-01-27T09:29:03.005 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify_test_cb 2021-01-27T09:29:03.006 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (422 ms) 2021-01-27T09:29:03.006 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2021-01-27T09:29:03.006 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-01-27T09:29:03.006 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93926898565296 err -107 2021-01-27T09:29:03.007 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1009 ms) 2021-01-27T09:29:03.007 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2021-01-27T09:29:03.007 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93926898576944 err -107 2021-01-27T09:29:03.007 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-01-27T09:29:03.007 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (11 ms) 2021-01-27T09:29:03.008 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2021-01-27T09:29:03.008 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874240 cookie 93926898582000 2021-01-27T09:29:03.008 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (10 ms) 2021-01-27T09:29:03.008 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2021-01-27T09:29:03.008 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874241 cookie 93926898582000 2021-01-27T09:29:03.009 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (7 ms) 2021-01-27T09:29:03.009 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2021-01-27T09:29:03.009 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874240 cookie 93926898612704 2021-01-27T09:29:03.009 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (10 ms) 2021-01-27T09:29:03.009 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2021-01-27T09:29:03.010 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874241 cookie 93926898613728 2021-01-27T09:29:03.010 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874241 cookie 93926898616096 2021-01-27T09:29:03.010 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (13 ms) 2021-01-27T09:29:03.010 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2021-01-27T09:29:03.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 279172874240 cookie 93926898616096 2021-01-27T09:29:03.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 283467841537 cookie 93926898616096 2021-01-27T09:29:03.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3021 ms) 2021-01-27T09:29:03.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2021-01-27T09:29:03.011 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: waiting up to 64 for osd to time us out ... 2021-01-27T09:29:03.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93926898616096 err -107 2021-01-27T09:29:03.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_cb from 24862 notify_id 304942678019 cookie 93926898616096 2021-01-27T09:29:03.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5133 ms) 2021-01-27T09:29:03.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2021-01-27T09:29:03.012 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93926898612880 err -107 2021-01-27T09:29:03.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2021-01-27T09:29:03.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (116 ms) 2021-01-27T09:29:03.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9752 ms total) 2021-01-27T09:29:03.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: 2021-01-27T09:29:03.013 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2021-01-27T09:29:03.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2021-01-27T09:29:03.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: watch_notify_test_cb 2021-01-27T09:29:03.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1149 ms) 2021-01-27T09:29:03.014 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1149 ms total) 2021-01-27T09:29:03.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: 2021-01-27T09:29:03.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [----------] Global test environment tear-down 2021-01-27T09:29:03.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (29904 ms total) 2021-01-27T09:29:03.015 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify: [ PASSED ] 11 tests. 2021-01-27T09:29:03.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.909141+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:03.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.922574+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:03.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.922699+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.922944+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: cluster 2021-01-27T09:29:01.923129+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T09:29:03.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.929844+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.944306+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.103:0/175307924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.951649+0000 mon.a (mon.0) 892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.956526+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.984484+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:02 smithi047 bash[9721]: audit 2021-01-27T09:29:01.984867+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.909141+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.922574+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.922699+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.922944+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: cluster 2021-01-27T09:29:01.923129+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T09:29:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.929844+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.944306+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.103:0/175307924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.951649+0000 mon.a (mon.0) 892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.956526+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.984484+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[13570]: audit 2021-01-27T09:29:01.984867+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.909141+0000 mon.a (mon.0) 887 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.922574+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.922699+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.922944+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.103:0/130367571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: cluster 2021-01-27T09:29:01.923129+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T09:29:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.929844+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.944306+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.103:0/175307924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.951649+0000 mon.a (mon.0) 892 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:03.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.956526+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.103:0/1231803901' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.984484+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]: dispatch 2021-01-27T09:29:03.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:02 smithi103 bash[9772]: audit 2021-01-27T09:29:01.984867+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:04.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: cluster 2021-01-27T09:29:02.350615+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v372: 552 pgs: 21 creating+peering, 134 unknown, 397 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2021-01-27T09:29:04.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: audit 2021-01-27T09:29:02.916034+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:04.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: audit 2021-01-27T09:29:02.951078+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: audit 2021-01-27T09:29:02.951230+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:04.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: audit 2021-01-27T09:29:02.951301+0000 mon.a (mon.0) 898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[13570]: cluster 2021-01-27T09:29:02.951496+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T09:29:04.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: cluster 2021-01-27T09:29:02.350615+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v372: 552 pgs: 21 creating+peering, 134 unknown, 397 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2021-01-27T09:29:04.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: audit 2021-01-27T09:29:02.916034+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:04.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: audit 2021-01-27T09:29:02.951078+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: audit 2021-01-27T09:29:02.951230+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:04.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: audit 2021-01-27T09:29:02.951301+0000 mon.a (mon.0) 898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[9772]: cluster 2021-01-27T09:29:02.951496+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T09:29:04.412 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:04 smithi103 bash[10018]: debug 2021-01-27T09:29:04.099+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:04.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: cluster 2021-01-27T09:29:02.350615+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v372: 552 pgs: 21 creating+peering, 134 unknown, 397 active+clean; 144 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2021-01-27T09:29:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: audit 2021-01-27T09:29:02.916034+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: audit 2021-01-27T09:29:02.951078+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: audit 2021-01-27T09:29:02.951230+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32473-12"}]': finished 2021-01-27T09:29:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: audit 2021-01-27T09:29:02.951301+0000 mon.a (mon.0) 898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:04 smithi047 bash[9721]: cluster 2021-01-27T09:29:02.951496+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T09:29:04.618 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2021-01-27T09:29:04.619 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [----------] Global test environment set-up. 2021-01-27T09:29:04.619 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2021-01-27T09:29:04.623 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2021-01-27T09:29:04.624 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5754 ms) 2021-01-27T09:29:04.624 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2021-01-27T09:29:04.625 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (34 ms) 2021-01-27T09:29:04.625 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2021-01-27T09:29:04.625 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20437 ms) 2021-01-27T09:29:04.626 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2021-01-27T09:29:04.626 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: attempt 0 of 20 2021-01-27T09:29:04.626 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: failed to deregister: 2021-01-27T09:29:04.626 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: { 2021-01-27T09:29:04.627 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "epoch": 20, 2021-01-27T09:29:04.627 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "modified": "2021-01-27T09:29:00.349496+0000", 2021-01-27T09:29:04.627 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "services": { 2021-01-27T09:29:04.628 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "laundry": { 2021-01-27T09:29:04.628 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "daemons": { 2021-01-27T09:29:04.628 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "summary": "", 2021-01-27T09:29:04.629 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "close-test-pid32617": { 2021-01-27T09:29:04.629 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_epoch": 20, 2021-01-27T09:29:04.629 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_stamp": "2021-01-27T09:28:59.502830+0000", 2021-01-27T09:29:04.630 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "gid": 36701, 2021-01-27T09:29:04.630 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "addr": "172.21.15.103:0/2634490525", 2021-01-27T09:29:04.630 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "metadata": { 2021-01-27T09:29:04.630 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "arch": "x86_64", 2021-01-27T09:29:04.631 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_release": "quincy", 2021-01-27T09:29:04.631 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev)", 2021-01-27T09:29:04.631 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version_short": "17.0.0-184-g507028cb", 2021-01-27T09:29:04.632 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-01-27T09:29:04.632 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro": "ubuntu", 2021-01-27T09:29:04.632 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.1 LTS", 2021-01-27T09:29:04.633 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_version": "20.04", 2021-01-27T09:29:04.633 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "foo": "bar", 2021-01-27T09:29:04.633 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "hostname": "smithi103", 2021-01-27T09:29:04.634 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_description": "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", 2021-01-27T09:29:04.634 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_version": "5.4.0-65-generic", 2021-01-27T09:29:04.634 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_swap_kb": "2097148", 2021-01-27T09:29:04.634 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_total_kb": "32771768", 2021-01-27T09:29:04.635 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "os": "Linux", 2021-01-27T09:29:04.635 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "this": "that" 2021-01-27T09:29:04.635 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: }, 2021-01-27T09:29:04.636 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "task_status": {} 2021-01-27T09:29:04.636 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: }, 2021-01-27T09:29:04.636 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "pid32606": { 2021-01-27T09:29:04.637 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_epoch": 19, 2021-01-27T09:29:04.637 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_stamp": "2021-01-27T09:28:58.237160+0000", 2021-01-27T09:29:04.637 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "gid": 24892, 2021-01-27T09:29:04.637 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "addr": "172.21.15.103:0/2126661887", 2021-01-27T09:29:04.638 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "metadata": { 2021-01-27T09:29:04.638 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "arch": "x86_64", 2021-01-27T09:29:04.638 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_release": "quincy", 2021-01-27T09:29:04.639 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev)", 2021-01-27T09:29:04.639 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version_short": "17.0.0-184-g507028cb", 2021-01-27T09:29:04.639 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-01-27T09:29:04.640 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro": "ubuntu", 2021-01-27T09:29:04.640 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.1 LTS", 2021-01-27T09:29:04.640 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_version": "20.04", 2021-01-27T09:29:04.641 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "foo": "bar", 2021-01-27T09:29:04.641 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "hostname": "smithi103", 2021-01-27T09:29:04.641 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_description": "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", 2021-01-27T09:29:04.641 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_version": "5.4.0-65-generic", 2021-01-27T09:29:04.642 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_swap_kb": "2097148", 2021-01-27T09:29:04.642 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_total_kb": "32771768", 2021-01-27T09:29:04.642 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "os": "Linux", 2021-01-27T09:29:04.643 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "this": "that" 2021-01-27T09:29:04.643 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: }, 2021-01-27T09:29:04.643 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "task_status": {} 2021-01-27T09:29:04.644 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:04.644 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:04.644 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: }, 2021-01-27T09:29:04.645 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "rgw": { 2021-01-27T09:29:04.645 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "daemons": { 2021-01-27T09:29:04.645 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "summary": "", 2021-01-27T09:29:04.645 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "realm.zone.a": { 2021-01-27T09:29:04.646 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_epoch": 12, 2021-01-27T09:29:04.646 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "start_stamp": "2021-01-27T09:24:44.915572+0000", 2021-01-27T09:29:04.646 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "gid": 24427, 2021-01-27T09:29:04.647 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "addr": "172.21.15.103:0/798509824", 2021-01-27T09:29:04.647 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "metadata": { 2021-01-27T09:29:04.647 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "arch": "x86_64", 2021-01-27T09:29:04.648 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_release": "quincy", 2021-01-27T09:29:04.648 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev)", 2021-01-27T09:29:04.648 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "ceph_version_short": "17.0.0-184-g507028cb", 2021-01-27T09:29:04.648 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "container_hostname": "smithi103", 2021-01-27T09:29:04.649 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "container_image": "quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096", 2021-01-27T09:29:04.649 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-01-27T09:29:04.649 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro": "centos", 2021-01-27T09:29:04.650 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_description": "CentOS Linux 8", 2021-01-27T09:29:04.650 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "distro_version": "8", 2021-01-27T09:29:04.650 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2021-01-27T09:29:04.651 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "frontend_type#0": "beast", 2021-01-27T09:29:04.651 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "hostname": "smithi103", 2021-01-27T09:29:04.651 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_description": "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", 2021-01-27T09:29:04.651 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "kernel_version": "5.4.0-65-generic", 2021-01-27T09:29:04.652 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_swap_kb": "2097148", 2021-01-27T09:29:04.652 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "mem_total_kb": "32771768", 2021-01-27T09:29:04.652 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "num_handles": "1", 2021-01-27T09:29:04.653 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "os": "Linux", 2021-01-27T09:29:04.653 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "pid": "1", 2021-01-27T09:29:04.653 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "zone_id": "124aeeb5-2341-4236-8a37-0e3d4f809f56", 2021-01-27T09:29:04.653 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "zone_name": "zone", 2021-01-27T09:29:04.654 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "zonegroup_id": "b0e784e6-3e4e-4126-8dc7-3314dc5eea3c", 2021-01-27T09:29:04.654 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "zonegroup_name": "default" 2021-01-27T09:29:04.654 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: }, 2021-01-27T09:29:04.654 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: "task_status": {} 2021-01-27T09:29:04.655 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:04.655 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:04.655 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:05.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.104474+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:05.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.219164+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:05.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.269900+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.103:0/2185920555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.278712+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.599922+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.15.103:0/451721610' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:05.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: cluster 2021-01-27T09:29:04.859507+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T09:29:05.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.869694+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:05 smithi047 bash[9721]: audit 2021-01-27T09:29:04.873243+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.104474+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:05.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.219164+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:05.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.269900+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.103:0/2185920555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.278712+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.599922+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.15.103:0/451721610' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:05.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: cluster 2021-01-27T09:29:04.859507+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T09:29:05.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.869694+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[9772]: audit 2021-01-27T09:29:04.873243+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.104474+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:05.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.219164+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:05.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.269900+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.103:0/2185920555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.278712+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.599922+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.15.103:0/451721610' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:05.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: cluster 2021-01-27T09:29:04.859507+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T09:29:05.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.869694+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:05.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:05 smithi103 bash[13570]: audit 2021-01-27T09:29:04.873243+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: cluster 2021-01-27T09:29:04.352181+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v375: 552 pgs: 23 creating+peering, 112 unknown, 417 active+clean; 144 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 4.0 KiB/s wr, 1 op/s 2021-01-27T09:29:07.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:04.602310+0000 mgr.y (mgr.14138) 506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:07.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.224934+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:07.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.268929+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.269110+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: cluster 2021-01-27T09:29:05.269257+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T09:29:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.287195+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.103:0/1574990295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.305120+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: cluster 2021-01-27T09:29:05.499041+0000 mon.a (mon.0) 909 : cluster [WRN] pool 'test-rados-api-smithi103-32172-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-27T09:29:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: cluster 2021-01-27T09:29:05.499616+0000 mon.a (mon.0) 910 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-27T09:29:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.501996+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.515255+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: cluster 2021-01-27T09:29:05.515492+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T09:29:07.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:06 smithi047 bash[9721]: audit 2021-01-27T09:29:05.519420+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:07.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: cluster 2021-01-27T09:29:04.352181+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v375: 552 pgs: 23 creating+peering, 112 unknown, 417 active+clean; 144 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 4.0 KiB/s wr, 1 op/s 2021-01-27T09:29:07.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:04.602310+0000 mgr.y (mgr.14138) 506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:07.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.224934+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.268929+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.269110+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: cluster 2021-01-27T09:29:05.269257+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T09:29:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.287195+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.103:0/1574990295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.305120+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: cluster 2021-01-27T09:29:05.499041+0000 mon.a (mon.0) 909 : cluster [WRN] pool 'test-rados-api-smithi103-32172-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-27T09:29:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: cluster 2021-01-27T09:29:05.499616+0000 mon.a (mon.0) 910 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-27T09:29:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.501996+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.515255+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: cluster 2021-01-27T09:29:05.515492+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T09:29:07.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[9772]: audit 2021-01-27T09:29:05.519420+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: cluster 2021-01-27T09:29:04.352181+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v375: 552 pgs: 23 creating+peering, 112 unknown, 417 active+clean; 144 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 4.0 KiB/s wr, 1 op/s 2021-01-27T09:29:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:04.602310+0000 mgr.y (mgr.14138) 506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.224934+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.268929+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32406-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.269110+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: cluster 2021-01-27T09:29:05.269257+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T09:29:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.287195+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.103:0/1574990295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.305120+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:07.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: cluster 2021-01-27T09:29:05.499041+0000 mon.a (mon.0) 909 : cluster [WRN] pool 'test-rados-api-smithi103-32172-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-27T09:29:07.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: cluster 2021-01-27T09:29:05.499616+0000 mon.a (mon.0) 910 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-27T09:29:07.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.501996+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:07.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.515255+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:07.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: cluster 2021-01-27T09:29:05.515492+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T09:29:07.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:06 smithi103 bash[13570]: audit 2021-01-27T09:29:05.519420+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:08.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: cluster 2021-01-27T09:29:06.352910+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v378: 520 pgs: 10 creating+peering, 92 unknown, 418 active+clean; 144 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-27T09:29:08.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.750099+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:08.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.783900+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:08.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: cluster 2021-01-27T09:29:06.784157+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T09:29:08.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.796507+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.797678+0000 mon.b (mon.2) 27 : audit [INF] from='client.? 172.21.15.103:0/1678047770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.799580+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.103:0/1789505304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.801819+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.808921+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:07 smithi047 bash[9721]: audit 2021-01-27T09:29:06.809267+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: cluster 2021-01-27T09:29:06.352910+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v378: 520 pgs: 10 creating+peering, 92 unknown, 418 active+clean; 144 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-27T09:29:08.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.750099+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:08.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.783900+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:08.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: cluster 2021-01-27T09:29:06.784157+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T09:29:08.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.796507+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.797678+0000 mon.b (mon.2) 27 : audit [INF] from='client.? 172.21.15.103:0/1678047770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.799580+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.103:0/1789505304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.801819+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.808921+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[9772]: audit 2021-01-27T09:29:06.809267+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: cluster 2021-01-27T09:29:06.352910+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v378: 520 pgs: 10 creating+peering, 92 unknown, 418 active+clean; 144 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-27T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.750099+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.783900+0000 mon.a (mon.0) 915 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: cluster 2021-01-27T09:29:06.784157+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T09:29:08.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.796507+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.797678+0000 mon.b (mon.2) 27 : audit [INF] from='client.? 172.21.15.103:0/1678047770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.799580+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.103:0/1789505304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.801819+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:08.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.808921+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:08.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:07 smithi103 bash[13570]: audit 2021-01-27T09:29:06.809267+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.752223+0000 mon.a (mon.0) 920 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.786990+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.787103+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:09.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.787200+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: cluster 2021-01-27T09:29:07.787381+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T09:29:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.791843+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.103:0/2274803533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.793070+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:07.972177+0000 mon.b (mon.2) 28 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:08.531236+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:08 smithi047 bash[9721]: audit 2021-01-27T09:29:08.753594+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.752223+0000 mon.a (mon.0) 920 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.786990+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.787103+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.787200+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: cluster 2021-01-27T09:29:07.787381+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T09:29:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.791843+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.103:0/2274803533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.793070+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:07.972177+0000 mon.b (mon.2) 28 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:08.531236+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[9772]: audit 2021-01-27T09:29:08.753594+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.752223+0000 mon.a (mon.0) 920 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.786990+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.787103+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.787200+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: cluster 2021-01-27T09:29:07.787381+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T09:29:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.791843+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.103:0/2274803533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.793070+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:07.972177+0000 mon.b (mon.2) 28 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:08.531236+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:08 smithi103 bash[13570]: audit 2021-01-27T09:29:08.753594+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:09.845 INFO:tasks.workunit.client.0.smithi103.stdout: api_ser api_c_write_operations: Running main() from gmock_main.cc 2021-01-27T09:29:09.845 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2021-01-27T09:29:09.845 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] Global test environment set-up. 2021-01-27T09:29:09.846 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2021-01-27T09:29:09.846 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2021-01-27T09:29:09.846 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2021-01-27T09:29:09.846 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2021-01-27T09:29:09.847 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: 2021-01-27T09:29:09.847 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2021-01-27T09:29:09.847 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2021-01-27T09:29:09.847 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (12203 ms) 2021-01-27T09:29:09.847 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2021-01-27T09:29:09.848 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (7058 ms) 2021-01-27T09:29:09.848 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2021-01-27T09:29:09.848 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3566 ms) 2021-01-27T09:29:09.848 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2021-01-27T09:29:09.848 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3030 ms) 2021-01-27T09:29:09.849 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2021-01-27T09:29:09.849 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3991 ms) 2021-01-27T09:29:09.849 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2021-01-27T09:29:09.849 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3813 ms) 2021-01-27T09:29:09.849 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2021-01-27T09:29:09.850 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3032 ms) 2021-01-27T09:29:09.850 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (36693 ms total) 2021-01-27T09:29:09.850 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: 2021-01-27T09:29:09.850 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [----------] Global test environment tear-down 2021-01-27T09:29:09.850 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (36693 ms total) 2021-01-27T09:29:09.851 INFO:tasks.workunit.client.0.smithi103.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2021-01-27T09:29:10.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: cluster 2021-01-27T09:29:08.354505+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v381: 584 pgs: 24 creating+peering, 64 unknown, 496 active+clean; 144 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2021-01-27T09:29:10.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: audit 2021-01-27T09:29:08.802628+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:10.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: audit 2021-01-27T09:29:08.802834+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:10.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: cluster 2021-01-27T09:29:08.802886+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T09:29:10.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: audit 2021-01-27T09:29:08.848076+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: audit 2021-01-27T09:29:08.858609+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[9772]: audit 2021-01-27T09:29:09.788624+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:10.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: cluster 2021-01-27T09:29:08.354505+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v381: 584 pgs: 24 creating+peering, 64 unknown, 496 active+clean; 144 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2021-01-27T09:29:10.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: audit 2021-01-27T09:29:08.802628+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:10.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: audit 2021-01-27T09:29:08.802834+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:10.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: cluster 2021-01-27T09:29:08.802886+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T09:29:10.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: audit 2021-01-27T09:29:08.848076+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: audit 2021-01-27T09:29:08.858609+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:09 smithi103 bash[13570]: audit 2021-01-27T09:29:09.788624+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:10.201 INFO:tasks.workunit.client.0.smithi103.stdout:vice_pp: } 2021-01-27T09:29:10.201 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: } 2021-01-27T09:29:10.201 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: 2021-01-27T09:29:10.202 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: attempt 1 of 20 2021-01-27T09:29:10.202 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10821 ms) 2021-01-27T09:29:10.202 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (37046 ms total) 2021-01-27T09:29:10.202 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: 2021-01-27T09:29:10.202 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [----------] Global test environment tear-down 2021-01-27T09:29:10.203 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (37046 ms total) 2021-01-27T09:29:10.203 INFO:tasks.workunit.client.0.smithi103.stdout: api_service_pp: [ PASSED ] 4 tests. 2021-01-27T09:29:10.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: cluster 2021-01-27T09:29:08.354505+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v381: 584 pgs: 24 creating+peering, 64 unknown, 496 active+clean; 144 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2021-01-27T09:29:10.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: audit 2021-01-27T09:29:08.802628+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32627-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:10.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: audit 2021-01-27T09:29:08.802834+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:10.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: cluster 2021-01-27T09:29:08.802886+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T09:29:10.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: audit 2021-01-27T09:29:08.848076+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: audit 2021-01-27T09:29:08.858609+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]: dispatch 2021-01-27T09:29:10.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:09 smithi047 bash[9721]: audit 2021-01-27T09:29:09.788624+0000 mon.a (mon.0) 932 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:11.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:09.839900+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:11.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: cluster 2021-01-27T09:29:09.840117+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-27T09:29:11.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:09.842543+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.103:0/379214692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:09.851077+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.189873+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.190530+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.198208+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.103:0/3391018974' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.199080+0000 mgr.y (mgr.14138) 509 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.218587+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.219646+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.228102+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.228529+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: audit 2021-01-27T09:29:10.792890+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:11.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:11 smithi047 bash[9721]: cluster 2021-01-27T09:29:10.819339+0000 mon.a (mon.0) 940 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-27T09:29:11.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:09.839900+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:11.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: cluster 2021-01-27T09:29:09.840117+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-27T09:29:11.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:09.842543+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.103:0/379214692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:09.851077+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.189873+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.190530+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.198208+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.103:0/3391018974' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.199080+0000 mgr.y (mgr.14138) 509 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.218587+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.219646+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.228102+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.228529+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: audit 2021-01-27T09:29:10.792890+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:11.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[13570]: cluster 2021-01-27T09:29:10.819339+0000 mon.a (mon.0) 940 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-27T09:29:11.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:09.839900+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-7"}]': finished 2021-01-27T09:29:11.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: cluster 2021-01-27T09:29:09.840117+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-27T09:29:11.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:09.842543+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.103:0/379214692' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:09.851077+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:11.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.189873+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.190530+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.198208+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.103:0/3391018974' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.199080+0000 mgr.y (mgr.14138) 509 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-27T09:29:11.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.218587+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.219646+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:11.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.228102+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.228529+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:11.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: audit 2021-01-27T09:29:10.792890+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:11.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:11 smithi103 bash[9772]: cluster 2021-01-27T09:29:10.819339+0000 mon.a (mon.0) 940 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-27T09:29:13.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: cluster 2021-01-27T09:29:10.358715+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v384: 520 pgs: 41 unknown, 479 active+clean; 144 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-01-27T09:29:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:10.826703+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:10.826896+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: cluster 2021-01-27T09:29:10.827018+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-27T09:29:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:10.888305+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:11.547067+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:11.591279+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:11.592771+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:12 smithi047 bash[9721]: audit 2021-01-27T09:29:12.156720+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:13.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: cluster 2021-01-27T09:29:10.358715+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v384: 520 pgs: 41 unknown, 479 active+clean; 144 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-01-27T09:29:13.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:10.826703+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:13.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:10.826896+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: cluster 2021-01-27T09:29:10.827018+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-27T09:29:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:10.888305+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:11.547067+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:11.591279+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:11.592771+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[9772]: audit 2021-01-27T09:29:12.156720+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:13.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: cluster 2021-01-27T09:29:10.358715+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v384: 520 pgs: 41 unknown, 479 active+clean; 144 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-01-27T09:29:13.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:10.826703+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:13.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:10.826896+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:13.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: cluster 2021-01-27T09:29:10.827018+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-27T09:29:13.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:10.888305+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:11.547067+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:13.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:11.591279+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:11.592771+0000 mon.a (mon.0) 945 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]: dispatch 2021-01-27T09:29:13.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:12 smithi103 bash[13570]: audit 2021-01-27T09:29:12.156720+0000 mon.a (mon.0) 946 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:14.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[10018]: debug 2021-01-27T09:29:14.111+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:14.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:15.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.225897+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: cluster 2021-01-27T09:29:12.359456+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v387: 424 pgs: 64 unknown, 360 active+clean; 144 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:15.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.865918+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]': finished 2021-01-27T09:29:15.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: cluster 2021-01-27T09:29:12.866041+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-27T09:29:15.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.866609+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.899491+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.899760+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:12.911671+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: cluster 2021-01-27T09:29:13.475342+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:15.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:14 smithi047 bash[9721]: audit 2021-01-27T09:29:13.479034+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:15.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.225897+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: cluster 2021-01-27T09:29:12.359456+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v387: 424 pgs: 64 unknown, 360 active+clean; 144 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:15.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.865918+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]': finished 2021-01-27T09:29:15.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: cluster 2021-01-27T09:29:12.866041+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-27T09:29:15.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.866609+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.899491+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.899760+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:12.911671+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: cluster 2021-01-27T09:29:13.475342+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:15.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[9772]: audit 2021-01-27T09:29:13.479034+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:15.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.225897+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: cluster 2021-01-27T09:29:12.359456+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v387: 424 pgs: 64 unknown, 360 active+clean; 144 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:15.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.865918+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32520-4"}]': finished 2021-01-27T09:29:15.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: cluster 2021-01-27T09:29:12.866041+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-27T09:29:15.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.866609+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.899491+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]: dispatch 2021-01-27T09:29:15.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.899760+0000 mon.a (mon.0) 950 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:12.911671+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:15.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: cluster 2021-01-27T09:29:13.475342+0000 mon.a (mon.0) 952 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:15.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:14 smithi103 bash[13570]: audit 2021-01-27T09:29:13.479034+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:15.556 INFO:tasks.workunit.client.0.smithi103.stdout:api_watch_notify_pp: flushed 2021-01-27T09:29:15.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3020 ms) 2021-01-27T09:29:15.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2021-01-27T09:29:15.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: trying... 2021-01-27T09:29:15.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978985040 notify_id 343597383682 notifier_gid 25090 2021-01-27T09:29:15.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: timed out 2021-01-27T09:29:15.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: flushing 2021-01-27T09:29:15.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: flushed 2021-01-27T09:29:15.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3015 ms) 2021-01-27T09:29:15.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2021-01-27T09:29:15.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: List watches 2021-01-27T09:29:15.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify2 2021-01-27T09:29:15.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978985040 notify_id 360777252867 notifier_gid 25090 2021-01-27T09:29:15.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify2 done 2021-01-27T09:29:15.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: watch_check 2021-01-27T09:29:15.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: unwatch2 2021-01-27T09:29:15.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: flushing 2021-01-27T09:29:15.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: done 2021-01-27T09:29:15.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3077 ms) 2021-01-27T09:29:15.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2021-01-27T09:29:15.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: List watches 2021-01-27T09:29:15.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify2 2021-01-27T09:29:15.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: handle_notify cookie 94843978985040 notify_id 369367187459 notifier_gid 25090 2021-01-27T09:29:15.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: notify2 done 2021-01-27T09:29:15.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: watch_check 2021-01-27T09:29:15.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: unwatch2 2021-01-27T09:29:15.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: flushing 2021-01-27T09:29:15.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: done 2021-01-27T09:29:15.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3021 ms) 2021-01-27T09:29:15.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16620 ms total) 2021-01-27T09:29:15.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: 2021-01-27T09:29:15.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2021-01-27T09:29:15.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (42459 ms total) 2021-01-27T09:29:15.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2021-01-27T09:29:16.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.502752+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:16.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.502987+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:29:16.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.503068+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.503148+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.542321+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:13.584042+0000 mon.b (mon.2) 33 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: cluster 2021-01-27T09:29:14.069417+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-27T09:29:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.074312+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.090826+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.114232+0000 mgr.y (mgr.14138) 512 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:16.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: cluster 2021-01-27T09:29:14.360235+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v389: 464 pgs: 31 creating+peering, 73 unknown, 360 active+clean; 144 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 451 B/s rd, 1 op/s 2021-01-27T09:29:16.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.658550+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-27T09:29:16.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.658739+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: cluster 2021-01-27T09:29:14.659068+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T09:29:16.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.662051+0000 mon.a (mon.0) 964 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:16.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.685189+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]: dispatch 2021-01-27T09:29:16.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.685673+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:14.688194+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.510619+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]': finished 2021-01-27T09:29:16.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.510686+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.510778+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:16.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: cluster 2021-01-27T09:29:15.510887+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T09:29:16.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.513569+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.518197+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.057 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:15 smithi047 bash[9721]: audit 2021-01-27T09:29:15.538640+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.502752+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:16.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.502987+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:29:16.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.503068+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.503148+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.542321+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:13.584042+0000 mon.b (mon.2) 33 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: cluster 2021-01-27T09:29:14.069417+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-27T09:29:16.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.074312+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.090826+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.114232+0000 mgr.y (mgr.14138) 512 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:16.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: cluster 2021-01-27T09:29:14.360235+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v389: 464 pgs: 31 creating+peering, 73 unknown, 360 active+clean; 144 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 451 B/s rd, 1 op/s 2021-01-27T09:29:16.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.658550+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-27T09:29:16.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.658739+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: cluster 2021-01-27T09:29:14.659068+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T09:29:16.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.662051+0000 mon.a (mon.0) 964 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:16.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.685189+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]: dispatch 2021-01-27T09:29:16.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.685673+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:14.688194+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.510619+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]': finished 2021-01-27T09:29:16.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.510686+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.510778+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:16.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: cluster 2021-01-27T09:29:15.510887+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T09:29:16.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.513569+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.518197+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.150 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[9772]: audit 2021-01-27T09:29:15.538640+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.502752+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:16.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.502987+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32520-4", "tierpool": "test-rados-api-smithi103-32520-6"}]': finished 2021-01-27T09:29:16.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.503068+0000 mon.a (mon.0) 956 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32375-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.503148+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.542321+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.103:0/600636905' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:13.584042+0000 mon.b (mon.2) 33 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: cluster 2021-01-27T09:29:14.069417+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-27T09:29:16.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.074312+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.090826+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.114232+0000 mgr.y (mgr.14138) 512 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:16.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: cluster 2021-01-27T09:29:14.360235+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v389: 464 pgs: 31 creating+peering, 73 unknown, 360 active+clean; 144 MiB data, 672 MiB used, 715 GiB / 715 GiB avail; 451 B/s rd, 1 op/s 2021-01-27T09:29:16.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.658550+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi103-32520-6", "pool2": "test-rados-api-smithi103-32520-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-27T09:29:16.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.658739+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.103:0/1429762376' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: cluster 2021-01-27T09:29:14.659068+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T09:29:16.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.662051+0000 mon.a (mon.0) 964 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:16.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.685189+0000 mon.a (mon.0) 965 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]: dispatch 2021-01-27T09:29:16.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.685673+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:14.688194+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:16.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.510619+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache", "force_nonempty":""}]': finished 2021-01-27T09:29:16.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.510686+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.103:0/3100318871' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:16.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.510778+0000 mon.a (mon.0) 970 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:16.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: cluster 2021-01-27T09:29:15.510887+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T09:29:16.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.513569+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:16.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.518197+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:15 smithi103 bash[13570]: audit 2021-01-27T09:29:15.538640+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:16.531 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 10 monclient: shutdown 2021-01-27T09:29:16.532 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 20 monclient: shutdown discarding 0 pending message(s) 2021-01-27T09:29:16.532 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 shutdown_connections 2021-01-27T09:29:16.532 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5597967dcb60 0x5597967d6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:29:16.532 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5597967dd050 0x5597967db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:29:16.532 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 --2- 172.21.15.103:0/2069309486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5597967d7010 0x5597967dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:29:16.533 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 >> 172.21.15.103:0/2069309486 conn(0x559796739a30 msgr2=0x55979673be70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:29:16.533 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 shutdown_connections 2021-01-27T09:29:16.533 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 1 -- 172.21.15.103:0/2069309486 wait complete. 2021-01-27T09:29:16.533 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 10 monclient: shutdown 2021-01-27T09:29:16.534 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:28:33.059+0000 7f49cbd683c0 20 monclient: shutdown discarding 0 pending message(s) 2021-01-27T09:29:16.534 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (35 ms) 2021-01-27T09:29:16.534 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (35 ms total) 2021-01-27T09:29:16.534 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:29:16.534 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2021-01-27T09:29:16.535 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2021-01-27T09:29:16.535 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: started 0x559796674b10 2021-01-27T09:29:16.535 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: started 0x55979671e0d0 2021-01-27T09:29:16.535 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: started 2 aios 2021-01-27T09:29:16.535 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: waiting 0x559796674b10 2021-01-27T09:29:16.536 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: waiting 0x55979671e0d0 2021-01-27T09:29:16.536 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: done. 2021-01-27T09:29:16.536 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (14297 ms) 2021-01-27T09:29:16.536 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (14297 ms total) 2021-01-27T09:29:16.537 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:29:16.537 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2021-01-27T09:29:16.537 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2021-01-27T09:29:16.538 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2021-01-27T09:29:16.538 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2021-01-27T09:29:16.538 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.Exec (6 ms) 2021-01-27T09:29:16.538 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2021-01-27T09:29:16.538 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (11 ms) 2021-01-27T09:29:16.539 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2021-01-27T09:29:16.539 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (6 ms) 2021-01-27T09:29:16.539 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2021-01-27T09:29:16.539 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5814 ms) 2021-01-27T09:29:16.539 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2021-01-27T09:29:16.540 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2021-01-27T09:29:16.540 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2021-01-27T09:29:16.540 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2021-01-27T09:29:16.540 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2021-01-27T09:29:16.541 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (18732 ms) 2021-01-27T09:29:16.541 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] 8 tests from LibRadosMisc (24569 ms total) 2021-01-27T09:29:16.541 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: 2021-01-27T09:29:16.541 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [----------] Global test environment tear-down 2021-01-27T09:29:16.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (43493 ms total) 2021-01-27T09:29:16.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc: [ PASSED ] 11 tests. 2021-01-27T09:29:17.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: cluster 2021-01-27T09:29:15.658207+0000 mon.a (mon.0) 974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:15.666993+0000 mon.a (mon.0) 975 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:16.514330+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:16.514469+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:17.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: cluster 2021-01-27T09:29:16.514723+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T09:29:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:16.517314+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]: dispatch 2021-01-27T09:29:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:16.519419+0000 mon.b (mon.2) 35 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[9772]: audit 2021-01-27T09:29:16.520850+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:17.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: cluster 2021-01-27T09:29:15.658207+0000 mon.a (mon.0) 974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:17.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:15.666993+0000 mon.a (mon.0) 975 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:17.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:16.514330+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:17.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:16.514469+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:17.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: cluster 2021-01-27T09:29:16.514723+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T09:29:17.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:16.517314+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]: dispatch 2021-01-27T09:29:17.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:16.519419+0000 mon.b (mon.2) 35 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:17.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:17 smithi103 bash[13570]: audit 2021-01-27T09:29:16.520850+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:17.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: cluster 2021-01-27T09:29:15.658207+0000 mon.a (mon.0) 974 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:17.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:15.666993+0000 mon.a (mon.0) 975 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:17.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:16.514330+0000 mon.a (mon.0) 976 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32375-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:17.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:16.514469+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:17.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: cluster 2021-01-27T09:29:16.514723+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T09:29:17.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:16.517314+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]: dispatch 2021-01-27T09:29:17.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:16.519419+0000 mon.b (mon.2) 35 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:17.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:17 smithi047 bash[9721]: audit 2021-01-27T09:29:16.520850+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]: dispatch 2021-01-27T09:29:18.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: cluster 2021-01-27T09:29:16.361254+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v392: 492 pgs: 55 creating+peering, 92 unknown, 345 active+clean; 144 MiB data, 678 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:18.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.377993+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: cluster 2021-01-27T09:29:17.511744+0000 mon.a (mon.0) 982 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.525721+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]': finished 2021-01-27T09:29:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.526215+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]': finished 2021-01-27T09:29:18.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: cluster 2021-01-27T09:29:17.526740+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T09:29:18.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.529552+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.529873+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.616158+0000 mon.b (mon.2) 36 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:18.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[9772]: audit 2021-01-27T09:29:17.617526+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:18.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: cluster 2021-01-27T09:29:16.361254+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v392: 492 pgs: 55 creating+peering, 92 unknown, 345 active+clean; 144 MiB data, 678 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:18.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.377993+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:18.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: cluster 2021-01-27T09:29:17.511744+0000 mon.a (mon.0) 982 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:18.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.525721+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]': finished 2021-01-27T09:29:18.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.526215+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]': finished 2021-01-27T09:29:18.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: cluster 2021-01-27T09:29:17.526740+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T09:29:18.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.529552+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.529873+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.616158+0000 mon.b (mon.2) 36 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:18.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:18 smithi103 bash[13570]: audit 2021-01-27T09:29:17.617526+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:18.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: cluster 2021-01-27T09:29:16.361254+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v392: 492 pgs: 55 creating+peering, 92 unknown, 345 active+clean; 144 MiB data, 678 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:18.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.377993+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:18.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: cluster 2021-01-27T09:29:17.511744+0000 mon.a (mon.0) 982 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:18.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.525721+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.103:0/1934771368' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32375-8", "tierpool":"test-rados-api-smithi103-32375-8-cache"}]': finished 2021-01-27T09:29:18.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.526215+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-9", "mode": "writeback"}]': finished 2021-01-27T09:29:18.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: cluster 2021-01-27T09:29:17.526740+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T09:29:18.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.529552+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.529873+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:18.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.616158+0000 mon.b (mon.2) 36 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:18.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:18 smithi047 bash[9721]: audit 2021-01-27T09:29:17.617526+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:19.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: Running main() from gmock_main.cc 2021-01-27T09:29:19.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2021-01-27T09:29:19.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [----------] Global test environment set-up. 2021-01-27T09:29:19.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [----------] 7 tests from LibRadosPools 2021-01-27T09:29:19.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2021-01-27T09:29:19.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolList (11825 ms) 2021-01-27T09:29:19.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2021-01-27T09:29:19.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4906 ms) 2021-01-27T09:29:19.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2021-01-27T09:29:19.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4688 ms) 2021-01-27T09:29:19.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2021-01-27T09:29:19.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4571 ms) 2021-01-27T09:29:19.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2021-01-27T09:29:19.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6285 ms) 2021-01-27T09:29:19.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2021-01-27T09:29:19.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5530 ms) 2021-01-27T09:29:19.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2021-01-27T09:29:19.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8707 ms) 2021-01-27T09:29:19.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [----------] 7 tests from LibRadosPools (46512 ms total) 2021-01-27T09:29:19.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: 2021-01-27T09:29:19.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [----------] Global test environment tear-down 2021-01-27T09:29:19.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (46512 ms total) 2021-01-27T09:29:19.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_pool: [ PASSED ] 7 tests. 2021-01-27T09:29:19.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: cluster 2021-01-27T09:29:18.363591+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v395: 460 pgs: 44 creating+peering, 34 unknown, 382 active+clean; 144 MiB data, 669 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:19.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.379389+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.531423+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.531514+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.531761+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: cluster 2021-01-27T09:29:18.531825+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T09:29:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.534066+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.536176+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.740347+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.740658+0000 mgr.y (mgr.14138) 516 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.741465+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.741690+0000 mgr.y (mgr.14138) 517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.742503+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.742714+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.743539+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.743763+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.744620+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.744844+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.745656+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.745918+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.746786+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.747025+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.747874+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.748114+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.748888+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.749499+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.750324+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:18.750561+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[13570]: audit 2021-01-27T09:29:19.381032+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:19.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: cluster 2021-01-27T09:29:18.363591+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v395: 460 pgs: 44 creating+peering, 34 unknown, 382 active+clean; 144 MiB data, 669 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:19.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.379389+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:19.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.531423+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.531514+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.531761+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:19.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: cluster 2021-01-27T09:29:18.531825+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T09:29:19.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.534066+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.536176+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.740347+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.740658+0000 mgr.y (mgr.14138) 516 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.741465+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.741690+0000 mgr.y (mgr.14138) 517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.742503+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.742714+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.743539+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.743763+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.744620+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.744844+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.745656+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.745918+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.746786+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.747025+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.747874+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.748114+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.748888+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.749499+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.750324+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:18.750561+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.657 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:19 smithi103 bash[9772]: audit 2021-01-27T09:29:19.381032+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:19.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: cluster 2021-01-27T09:29:18.363591+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v395: 460 pgs: 44 creating+peering, 34 unknown, 382 active+clean; 144 MiB data, 669 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:29:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.379389+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.531423+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.103:0/2971579434' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.531514+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.103:0/2229149426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.531761+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: cluster 2021-01-27T09:29:18.531825+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T09:29:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.534066+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.536176+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]: dispatch 2021-01-27T09:29:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.740347+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.740658+0000 mgr.y (mgr.14138) 516 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.0"}]: dispatch 2021-01-27T09:29:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.741465+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.741690+0000 mgr.y (mgr.14138) 517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.1"}]: dispatch 2021-01-27T09:29:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.742503+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.742714+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.2"}]: dispatch 2021-01-27T09:29:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.743539+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.743763+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.3"}]: dispatch 2021-01-27T09:29:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.744620+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.744844+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.4"}]: dispatch 2021-01-27T09:29:19.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.745656+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.745918+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.5"}]: dispatch 2021-01-27T09:29:19.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.746786+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.747025+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.6"}]: dispatch 2021-01-27T09:29:19.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.747874+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.748114+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.7"}]: dispatch 2021-01-27T09:29:19.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.748888+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.749499+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.8"}]: dispatch 2021-01-27T09:29:19.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.750324+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:18.750561+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "14.9"}]: dispatch 2021-01-27T09:29:19.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:19 smithi047 bash[9721]: audit 2021-01-27T09:29:19.381032+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:20.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:20 smithi047 bash[9721]: cluster 2021-01-27T09:29:19.528847+0000 mon.a (mon.0) 996 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:20.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:20 smithi047 bash[9721]: audit 2021-01-27T09:29:19.539669+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:20.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:20 smithi047 bash[9721]: cluster 2021-01-27T09:29:19.540011+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T09:29:20.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[13570]: cluster 2021-01-27T09:29:19.528847+0000 mon.a (mon.0) 996 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:20.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[13570]: audit 2021-01-27T09:29:19.539669+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:20.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[13570]: cluster 2021-01-27T09:29:19.540011+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T09:29:20.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[9772]: cluster 2021-01-27T09:29:19.528847+0000 mon.a (mon.0) 996 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:20.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[9772]: audit 2021-01-27T09:29:19.539669+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-9"}]': finished 2021-01-27T09:29:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:20 smithi103 bash[9772]: cluster 2021-01-27T09:29:19.540011+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T09:29:21.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: cluster 2021-01-27T09:29:18.986078+0000 osd.0 (osd.0) 7 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:29:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: cluster 2021-01-27T09:29:19.893239+0000 osd.5 (osd.5) 5 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:29:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: cluster 2021-01-27T09:29:20.020393+0000 osd.0 (osd.0) 8 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:29:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: cluster 2021-01-27T09:29:20.364947+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v398: 332 pgs: 332 active+clean; 168 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:20.442276+0000 mon.a (mon.0) 999 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: cluster 2021-01-27T09:29:20.516539+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T09:29:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:20.517862+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:20.520066+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.103:0/1489364657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:20.547870+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:21.443867+0000 mon.a (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:21 smithi047 bash[9721]: audit 2021-01-27T09:29:21.445444+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:21.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: cluster 2021-01-27T09:29:18.986078+0000 osd.0 (osd.0) 7 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:29:21.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: cluster 2021-01-27T09:29:19.893239+0000 osd.5 (osd.5) 5 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:29:21.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: cluster 2021-01-27T09:29:20.020393+0000 osd.0 (osd.0) 8 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:29:21.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: cluster 2021-01-27T09:29:20.364947+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v398: 332 pgs: 332 active+clean; 168 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:21.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:20.442276+0000 mon.a (mon.0) 999 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: cluster 2021-01-27T09:29:20.516539+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T09:29:21.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:20.517862+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:20.520066+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.103:0/1489364657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:20.547870+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:21.443867+0000 mon.a (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[9772]: audit 2021-01-27T09:29:21.445444+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:21.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: cluster 2021-01-27T09:29:18.986078+0000 osd.0 (osd.0) 7 : cluster [DBG] 14.3 deep-scrub ok 2021-01-27T09:29:21.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: cluster 2021-01-27T09:29:19.893239+0000 osd.5 (osd.5) 5 : cluster [DBG] 14.7 deep-scrub ok 2021-01-27T09:29:21.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: cluster 2021-01-27T09:29:20.020393+0000 osd.0 (osd.0) 8 : cluster [DBG] 14.5 deep-scrub ok 2021-01-27T09:29:21.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: cluster 2021-01-27T09:29:20.364947+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v398: 332 pgs: 332 active+clean; 168 MiB data, 716 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:21.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:20.442276+0000 mon.a (mon.0) 999 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: cluster 2021-01-27T09:29:20.516539+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T09:29:21.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:20.517862+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:20.520066+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.103:0/1489364657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:20.547870+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:21.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:21.443867+0000 mon.a (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:21.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:21 smithi103 bash[13570]: audit 2021-01-27T09:29:21.445444+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:22.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: cluster 2021-01-27T09:29:20.882132+0000 osd.5 (osd.5) 6 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:29:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: cluster 2021-01-27T09:29:20.974172+0000 osd.0 (osd.0) 9 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.522091+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.522444+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.522811+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: cluster 2021-01-27T09:29:21.522924+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-27T09:29:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.526467+0000 mon.b (mon.2) 39 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.532595+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.533055+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.533899+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:22 smithi047 bash[9721]: audit 2021-01-27T09:29:21.535060+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:22.893 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[19187]: debug 2021-01-27T09:29:22.543+0000 7f4c0bc59700 -1 osd.1 pg_epoch: 100 pg[66.9( v 99'3 (0'0,99'3] local-lis/les=82/83 n=2 ec=82/82 lis/c=82/82 les/c/f=83/83/0 sis=82) [1,6,7] r=0 lpr=82 crt=99'3 lcod 98'1 mlcod 98'1 active+clean+snaptrim trimq=[11~1] ps=[a~3]] removing snap head 2021-01-27T09:29:22.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: cluster 2021-01-27T09:29:20.882132+0000 osd.5 (osd.5) 6 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:29:22.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: cluster 2021-01-27T09:29:20.974172+0000 osd.0 (osd.0) 9 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:22.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.522091+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.522444+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.522811+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:22.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: cluster 2021-01-27T09:29:21.522924+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-27T09:29:22.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.526467+0000 mon.b (mon.2) 39 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.532595+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.533055+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.533899+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[13570]: audit 2021-01-27T09:29:21.535060+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:22.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: cluster 2021-01-27T09:29:20.882132+0000 osd.5 (osd.5) 6 : cluster [DBG] 14.9 deep-scrub ok 2021-01-27T09:29:22.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: cluster 2021-01-27T09:29:20.974172+0000 osd.0 (osd.0) 9 : cluster [DBG] 14.6 deep-scrub ok 2021-01-27T09:29:22.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.522091+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.103:0/3159278779' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.522444+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:22.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.522811+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:22.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: cluster 2021-01-27T09:29:21.522924+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-27T09:29:22.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.526467+0000 mon.b (mon.2) 39 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.532595+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.533055+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:22.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.533899+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:22.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:22 smithi103 bash[9772]: audit 2021-01-27T09:29:21.535060+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:23.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: cluster 2021-01-27T09:29:22.258869+0000 osd.6 (osd.6) 5 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:29:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: cluster 2021-01-27T09:29:22.365996+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v401: 396 pgs: 6 creating+peering, 90 unknown, 300 active+clean; 168 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: audit 2021-01-27T09:29:22.527553+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: audit 2021-01-27T09:29:22.527838+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: cluster 2021-01-27T09:29:22.528710+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-27T09:29:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: audit 2021-01-27T09:29:22.530427+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: audit 2021-01-27T09:29:23.018928+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:23 smithi047 bash[9721]: cluster 2021-01-27T09:29:23.188908+0000 osd.3 (osd.3) 4 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:29:23.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: cluster 2021-01-27T09:29:22.258869+0000 osd.6 (osd.6) 5 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:29:23.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: cluster 2021-01-27T09:29:22.365996+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v401: 396 pgs: 6 creating+peering, 90 unknown, 300 active+clean; 168 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:23.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: audit 2021-01-27T09:29:22.527553+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:23.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: audit 2021-01-27T09:29:22.527838+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:23.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: cluster 2021-01-27T09:29:22.528710+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-27T09:29:23.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: audit 2021-01-27T09:29:22.530427+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: audit 2021-01-27T09:29:23.018928+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[9772]: cluster 2021-01-27T09:29:23.188908+0000 osd.3 (osd.3) 4 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:29:23.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: cluster 2021-01-27T09:29:22.258869+0000 osd.6 (osd.6) 5 : cluster [DBG] 14.2 deep-scrub ok 2021-01-27T09:29:23.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: cluster 2021-01-27T09:29:22.365996+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v401: 396 pgs: 6 creating+peering, 90 unknown, 300 active+clean; 168 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 6.0 MiB/s wr, 5 op/s 2021-01-27T09:29:23.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: audit 2021-01-27T09:29:22.527553+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:23.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: audit 2021-01-27T09:29:22.527838+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:23.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: cluster 2021-01-27T09:29:22.528710+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-27T09:29:23.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: audit 2021-01-27T09:29:22.530427+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: audit 2021-01-27T09:29:23.018928+0000 mon.a (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:23.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:23 smithi103 bash[13570]: cluster 2021-01-27T09:29:23.188908+0000 osd.3 (osd.3) 4 : cluster [DBG] 14.1 deep-scrub ok 2021-01-27T09:29:24.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[10018]: debug 2021-01-27T09:29:24.119+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:24.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:24.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: cluster 2021-01-27T09:29:23.245994+0000 osd.6 (osd.6) 6 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:29:24.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: cluster 2021-01-27T09:29:23.559284+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-27T09:29:24.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.563033+0000 mon.c (mon.1) 137 : audit [INF] from='client.? 172.21.15.103:0/246526116' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.563423+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.103:0/2056443288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.563485+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.564059+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.599210+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:24.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:23.600143+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:24.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:24.020615+0000 mon.a (mon.0) 1022 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:24.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[9772]: audit 2021-01-27T09:29:24.124327+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:24.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: cluster 2021-01-27T09:29:23.245994+0000 osd.6 (osd.6) 6 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:29:24.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: cluster 2021-01-27T09:29:23.559284+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-27T09:29:24.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.563033+0000 mon.c (mon.1) 137 : audit [INF] from='client.? 172.21.15.103:0/246526116' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.563423+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.103:0/2056443288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.563485+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.564059+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:24.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.599210+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:24.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:23.600143+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:24.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:24.020615+0000 mon.a (mon.0) 1022 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:24.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:24 smithi103 bash[13570]: audit 2021-01-27T09:29:24.124327+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:25.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: cluster 2021-01-27T09:29:23.245994+0000 osd.6 (osd.6) 6 : cluster [DBG] 14.4 deep-scrub ok 2021-01-27T09:29:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: cluster 2021-01-27T09:29:23.559284+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-27T09:29:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.563033+0000 mon.c (mon.1) 137 : audit [INF] from='client.? 172.21.15.103:0/246526116' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.563423+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.103:0/2056443288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.563485+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.564059+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.599210+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:23.600143+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:24.020615+0000 mon.a (mon.0) 1022 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:24 smithi047 bash[9721]: audit 2021-01-27T09:29:24.124327+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:26.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: cluster 2021-01-27T09:29:24.367108+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v404: 396 pgs: 80 unknown, 316 active+clean; 216 MiB data, 877 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s wr, 5 op/s 2021-01-27T09:29:26.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.565304+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.565439+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.565733+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:26.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: cluster 2021-01-27T09:29:24.565820+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T09:29:26.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.570901+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.572292+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.575313+0000 mon.b (mon.2) 41 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:24.578440+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.023140+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:26.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.521325+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:26.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.521585+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:26.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: cluster 2021-01-27T09:29:25.522047+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T09:29:26.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.523804+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.524261+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.526271+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:26 smithi047 bash[9721]: audit 2021-01-27T09:29:25.526707+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: cluster 2021-01-27T09:29:24.367108+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v404: 396 pgs: 80 unknown, 316 active+clean; 216 MiB data, 877 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s wr, 5 op/s 2021-01-27T09:29:26.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.565304+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.565439+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.565733+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:26.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: cluster 2021-01-27T09:29:24.565820+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T09:29:26.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.570901+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.572292+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.575313+0000 mon.b (mon.2) 41 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:24.578440+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.023140+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:26.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.521325+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:26.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.521585+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:26.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: cluster 2021-01-27T09:29:25.522047+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T09:29:26.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.523804+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.524261+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.526271+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[9772]: audit 2021-01-27T09:29:25.526707+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: cluster 2021-01-27T09:29:24.367108+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v404: 396 pgs: 80 unknown, 316 active+clean; 216 MiB data, 877 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s wr, 5 op/s 2021-01-27T09:29:26.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.565304+0000 mon.a (mon.0) 1023 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.565439+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:26.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.565733+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:26.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: cluster 2021-01-27T09:29:24.565820+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T09:29:26.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.570901+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.572292+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.575313+0000 mon.b (mon.2) 41 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:24.578440+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:26.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.023140+0000 mon.a (mon.0) 1029 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:26.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.521325+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:26.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.521585+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:26.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: cluster 2021-01-27T09:29:25.522047+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T09:29:26.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.523804+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.524261+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.103:0/3774184746' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:26.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.526271+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]: dispatch 2021-01-27T09:29:26.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:26 smithi103 bash[13570]: audit 2021-01-27T09:29:25.526707+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]: dispatch 2021-01-27T09:29:27.801 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[12576]: debug 2021-01-27T09:29:27.557+0000 7f173e346700 -1 osd.4 pg_epoch: 105 pg[83.14( v 104'2 (0'0,104'2] local-lis/les=99/100 n=2 ec=99/99 lis/c=99/99 les/c/f=100/100/0 sis=99) [4,6,1] r=0 lpr=99 crt=104'2 lcod 104'1 mlcod 104'1 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-01-27T09:29:27.802 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[17579]: debug 2021-01-27T09:29:27.545+0000 7f2186e30700 -1 osd.6 pg_epoch: 105 pg[63.14( v 101'3 (0'0,101'3] local-lis/les=80/81 n=2 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [6,0,7] r=0 lpr=80 crt=101'3 lcod 100'1 mlcod 100'1 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-01-27T09:29:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: cluster 2021-01-27T09:29:25.013870+0000 osd.0 (osd.0) 10 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: cluster 2021-01-27T09:29:25.624932+0000 osd.2 (osd.2) 4 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:29:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: cluster 2021-01-27T09:29:26.367968+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v407: 324 pgs: 2 unknown, 322 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 12 MiB/s wr, 10 op/s 2021-01-27T09:29:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.426645+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: cluster 2021-01-27T09:29:26.516458+0000 mon.a (mon.0) 1036 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.525577+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]': finished 2021-01-27T09:29:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.525816+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: cluster 2021-01-27T09:29:26.526231+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T09:29:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.530394+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.532536+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.103:0/2856295087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.533958+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.559674+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.560211+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.561349+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.561613+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.562063+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:27.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:27 smithi047 bash[9721]: audit 2021-01-27T09:29:26.562335+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:27.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: cluster 2021-01-27T09:29:25.013870+0000 osd.0 (osd.0) 10 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:27.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: cluster 2021-01-27T09:29:25.624932+0000 osd.2 (osd.2) 4 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:29:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: cluster 2021-01-27T09:29:26.367968+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v407: 324 pgs: 2 unknown, 322 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 12 MiB/s wr, 10 op/s 2021-01-27T09:29:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.426645+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: cluster 2021-01-27T09:29:26.516458+0000 mon.a (mon.0) 1036 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.525577+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]': finished 2021-01-27T09:29:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.525816+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: cluster 2021-01-27T09:29:26.526231+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T09:29:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.530394+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.532536+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.103:0/2856295087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.533958+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.559674+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.560211+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.561349+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.561613+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.562063+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:27.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[9772]: audit 2021-01-27T09:29:26.562335+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:27.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: cluster 2021-01-27T09:29:25.013870+0000 osd.0 (osd.0) 10 : cluster [DBG] 14.8 deep-scrub ok 2021-01-27T09:29:27.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: cluster 2021-01-27T09:29:25.624932+0000 osd.2 (osd.2) 4 : cluster [DBG] 14.0 deep-scrub ok 2021-01-27T09:29:27.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: cluster 2021-01-27T09:29:26.367968+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v407: 324 pgs: 2 unknown, 322 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 12 MiB/s wr, 10 op/s 2021-01-27T09:29:27.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.426645+0000 mon.a (mon.0) 1035 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:27.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: cluster 2021-01-27T09:29:26.516458+0000 mon.a (mon.0) 1036 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:27.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.525577+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-11", "mode": "writeback"}]': finished 2021-01-27T09:29:27.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.525816+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-9"}]': finished 2021-01-27T09:29:27.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: cluster 2021-01-27T09:29:26.526231+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T09:29:27.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.530394+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.532536+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.103:0/2856295087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.533958+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:27.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.559674+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.560211+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.561349+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.561613+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:27.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.562063+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:27.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:27 smithi103 bash[13570]: audit 2021-01-27T09:29:26.562335+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: cluster 2021-01-27T09:29:27.422770+0000 mon.a (mon.0) 1045 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.435258+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.529879+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.530116+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.531116+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:28.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: cluster 2021-01-27T09:29:27.531304+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T09:29:28.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.532814+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.534427+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.616296+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:28.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:28 smithi047 bash[9721]: audit 2021-01-27T09:29:27.617424+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:28.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: cluster 2021-01-27T09:29:27.422770+0000 mon.a (mon.0) 1045 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.435258+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.529879+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.530116+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.531116+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:28.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: cluster 2021-01-27T09:29:27.531304+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T09:29:28.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.532814+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.534427+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.616296+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:28.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[13570]: audit 2021-01-27T09:29:27.617424+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:28.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: cluster 2021-01-27T09:29:27.422770+0000 mon.a (mon.0) 1045 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:28.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.435258+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:28.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.529879+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.103:0/1421186892' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.530116+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:28.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.531116+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32389-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:28.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: cluster 2021-01-27T09:29:27.531304+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T09:29:28.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.532814+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.534427+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:28.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.616296+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:28.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:28 smithi103 bash[9772]: audit 2021-01-27T09:29:27.617424+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:29:30.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[9772]: audit 2021-01-27T09:29:28.436821+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:30.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[9772]: audit 2021-01-27T09:29:28.966542+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:30.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[9772]: cluster 2021-01-27T09:29:28.966824+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T09:29:30.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[9772]: audit 2021-01-27T09:29:28.967721+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:30.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[9772]: audit 2021-01-27T09:29:28.968955+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:30.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[13570]: audit 2021-01-27T09:29:28.436821+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:30.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[13570]: audit 2021-01-27T09:29:28.966542+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:30.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[13570]: cluster 2021-01-27T09:29:28.966824+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T09:29:30.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[13570]: audit 2021-01-27T09:29:28.967721+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:30.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:29 smithi103 bash[13570]: audit 2021-01-27T09:29:28.968955+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:30.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:29 smithi047 bash[9721]: audit 2021-01-27T09:29:28.436821+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:30.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:29 smithi047 bash[9721]: audit 2021-01-27T09:29:28.966542+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:29:30.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:29 smithi047 bash[9721]: cluster 2021-01-27T09:29:28.966824+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T09:29:30.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:29 smithi047 bash[9721]: audit 2021-01-27T09:29:28.967721+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:30.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:29 smithi047 bash[9721]: audit 2021-01-27T09:29:28.968955+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]: dispatch 2021-01-27T09:29:31.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: cluster 2021-01-27T09:29:28.369841+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v410: 388 pgs: 33 unknown, 355 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 258 KiB/s wr, 8 op/s 2021-01-27T09:29:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: cluster 2021-01-27T09:29:29.860048+0000 mon.a (mon.0) 1057 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.860648+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.875006+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.875104+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:31.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: cluster 2021-01-27T09:29:29.875247+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T09:29:31.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.876636+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.103:0/1618968568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.877658+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.103:0/2797904377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.877739+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:29.878370+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:30.524094+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: audit 2021-01-27T09:29:30.524422+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:31 smithi047 bash[9721]: cluster 2021-01-27T09:29:30.525239+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T09:29:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: cluster 2021-01-27T09:29:28.369841+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v410: 388 pgs: 33 unknown, 355 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 258 KiB/s wr, 8 op/s 2021-01-27T09:29:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: cluster 2021-01-27T09:29:29.860048+0000 mon.a (mon.0) 1057 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.860648+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.875006+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.875104+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: cluster 2021-01-27T09:29:29.875247+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T09:29:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.876636+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.103:0/1618968568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.877658+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.103:0/2797904377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.877739+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:29.878370+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:30.524094+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: audit 2021-01-27T09:29:30.524422+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[9772]: cluster 2021-01-27T09:29:30.525239+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T09:29:31.404 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: cluster 2021-01-27T09:29:28.369841+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v410: 388 pgs: 33 unknown, 355 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 258 KiB/s wr, 8 op/s 2021-01-27T09:29:31.404 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: cluster 2021-01-27T09:29:29.860048+0000 mon.a (mon.0) 1057 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:29:31.405 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.860648+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:31.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.875006+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32389-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:31.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.875104+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-11"}]': finished 2021-01-27T09:29:31.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: cluster 2021-01-27T09:29:29.875247+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T09:29:31.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.876636+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.103:0/1618968568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.877658+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.103:0/2797904377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.877739+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:29.878370+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:31.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:30.524094+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: audit 2021-01-27T09:29:30.524422+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:31.408 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:31 smithi103 bash[13570]: cluster 2021-01-27T09:29:30.525239+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T09:29:32.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:32 smithi047 bash[9721]: cluster 2021-01-27T09:29:30.370863+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v413: 396 pgs: 72 unknown, 324 active+clean; 216 MiB data, 889 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-01-27T09:29:32.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:32 smithi047 bash[9721]: audit 2021-01-27T09:29:30.999150+0000 mon.a (mon.0) 1067 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:32.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:32 smithi047 bash[9721]: cluster 2021-01-27T09:29:31.544784+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-27T09:29:32.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:32 smithi047 bash[9721]: audit 2021-01-27T09:29:31.548589+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:32.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:32 smithi047 bash[9721]: audit 2021-01-27T09:29:31.549815+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:32.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[13570]: cluster 2021-01-27T09:29:30.370863+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v413: 396 pgs: 72 unknown, 324 active+clean; 216 MiB data, 889 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-01-27T09:29:32.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[13570]: audit 2021-01-27T09:29:30.999150+0000 mon.a (mon.0) 1067 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:32.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[13570]: cluster 2021-01-27T09:29:31.544784+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-27T09:29:32.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[13570]: audit 2021-01-27T09:29:31.548589+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:32.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[13570]: audit 2021-01-27T09:29:31.549815+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[9772]: cluster 2021-01-27T09:29:30.370863+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v413: 396 pgs: 72 unknown, 324 active+clean; 216 MiB data, 889 MiB used, 714 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2021-01-27T09:29:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[9772]: audit 2021-01-27T09:29:30.999150+0000 mon.a (mon.0) 1067 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[9772]: cluster 2021-01-27T09:29:31.544784+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-27T09:29:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[9772]: audit 2021-01-27T09:29:31.548589+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:32.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:32 smithi103 bash[9772]: audit 2021-01-27T09:29:31.549815+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: cluster 2021-01-27T09:29:32.371771+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v416: 332 pgs: 40 unknown, 292 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:33.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.435311+0000 mon.a (mon.0) 1070 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:33.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.545661+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:33.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: cluster 2021-01-27T09:29:32.546302+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-27T09:29:33.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.556063+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.103:0/142841794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.556921+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.103:0/2746649291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.568415+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:32.568745+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:33 smithi047 bash[9721]: audit 2021-01-27T09:29:33.436873+0000 mon.a (mon.0) 1075 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:33.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: cluster 2021-01-27T09:29:32.371771+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v416: 332 pgs: 40 unknown, 292 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:33.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.435311+0000 mon.a (mon.0) 1070 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:33.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.545661+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:33.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: cluster 2021-01-27T09:29:32.546302+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-27T09:29:33.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.556063+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.103:0/142841794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.556921+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.103:0/2746649291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.568415+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:32.568745+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[13570]: audit 2021-01-27T09:29:33.436873+0000 mon.a (mon.0) 1075 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:33.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: cluster 2021-01-27T09:29:32.371771+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v416: 332 pgs: 40 unknown, 292 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:29:33.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.435311+0000 mon.a (mon.0) 1070 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:33.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.545661+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:33.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: cluster 2021-01-27T09:29:32.546302+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-27T09:29:33.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.556063+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.103:0/142841794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.556921+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.103:0/2746649291' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.568415+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:32.568745+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:33.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:33 smithi103 bash[9772]: audit 2021-01-27T09:29:33.436873+0000 mon.a (mon.0) 1075 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:34.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[10018]: debug 2021-01-27T09:29:34.131+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:34.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:34.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[9721]: audit 2021-01-27T09:29:33.551967+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[9721]: audit 2021-01-27T09:29:33.552182+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[9721]: cluster 2021-01-27T09:29:33.552636+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-27T09:29:34.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[9721]: audit 2021-01-27T09:29:34.134699+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:34.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:34 smithi047 bash[9721]: audit 2021-01-27T09:29:34.438721+0000 mon.a (mon.0) 1079 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:34.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[13570]: audit 2021-01-27T09:29:33.551967+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[13570]: audit 2021-01-27T09:29:33.552182+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[13570]: cluster 2021-01-27T09:29:33.552636+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-27T09:29:34.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[13570]: audit 2021-01-27T09:29:34.134699+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:34.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[13570]: audit 2021-01-27T09:29:34.438721+0000 mon.a (mon.0) 1079 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:34.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[9772]: audit 2021-01-27T09:29:33.551967+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[9772]: audit 2021-01-27T09:29:33.552182+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:34.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[9772]: cluster 2021-01-27T09:29:33.552636+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-27T09:29:34.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[9772]: audit 2021-01-27T09:29:34.134699+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:34.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:34 smithi103 bash[9772]: audit 2021-01-27T09:29:34.438721+0000 mon.a (mon.0) 1079 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:35.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[13570]: cluster 2021-01-27T09:29:34.372839+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v419: 396 pgs: 31 creating+peering, 51 unknown, 314 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 15 KiB/s wr, 10 op/s 2021-01-27T09:29:35.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[13570]: cluster 2021-01-27T09:29:34.545863+0000 mon.a (mon.0) 1080 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:35.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[13570]: cluster 2021-01-27T09:29:34.562216+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T09:29:35.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[13570]: audit 2021-01-27T09:29:35.494009+0000 mon.a (mon.0) 1082 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:35.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[13570]: cluster 2021-01-27T09:29:35.528936+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T09:29:35.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[9772]: cluster 2021-01-27T09:29:34.372839+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v419: 396 pgs: 31 creating+peering, 51 unknown, 314 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 15 KiB/s wr, 10 op/s 2021-01-27T09:29:35.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[9772]: cluster 2021-01-27T09:29:34.545863+0000 mon.a (mon.0) 1080 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:35.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[9772]: cluster 2021-01-27T09:29:34.562216+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T09:29:35.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[9772]: audit 2021-01-27T09:29:35.494009+0000 mon.a (mon.0) 1082 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:35.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:35 smithi103 bash[9772]: cluster 2021-01-27T09:29:35.528936+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T09:29:36.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:35 smithi047 bash[9721]: cluster 2021-01-27T09:29:34.372839+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v419: 396 pgs: 31 creating+peering, 51 unknown, 314 active+clean; 216 MiB data, 884 MiB used, 714 GiB / 715 GiB avail; 15 KiB/s wr, 10 op/s 2021-01-27T09:29:36.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:35 smithi047 bash[9721]: cluster 2021-01-27T09:29:34.545863+0000 mon.a (mon.0) 1080 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:36.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:35 smithi047 bash[9721]: cluster 2021-01-27T09:29:34.562216+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T09:29:36.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:35 smithi047 bash[9721]: audit 2021-01-27T09:29:35.494009+0000 mon.a (mon.0) 1082 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:36.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:35 smithi047 bash[9721]: cluster 2021-01-27T09:29:35.528936+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T09:29:36.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:35.535464+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.103:0/4065377184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:35.544963+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:35.551162+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:36.495436+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:36.534434+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: audit 2021-01-27T09:29:36.534666+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[13570]: cluster 2021-01-27T09:29:36.535003+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T09:29:36.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:35.535464+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.103:0/4065377184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:35.544963+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:35.551162+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:36.495436+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:36.534434+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: audit 2021-01-27T09:29:36.534666+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:36 smithi103 bash[9772]: cluster 2021-01-27T09:29:36.535003+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T09:29:37.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:35.535464+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.103:0/4065377184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:37.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:35.544963+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:37.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:35.551162+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:37.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:36.495436+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:37.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:36.534434+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.103:0/555073026' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:37.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: audit 2021-01-27T09:29:36.534666+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:37.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:36 smithi047 bash[9721]: cluster 2021-01-27T09:29:36.535003+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T09:29:37.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: cluster 2021-01-27T09:29:36.373921+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v422: 396 pgs: 67 unknown, 329 active+clean; 216 MiB data, 876 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 42 KiB/s wr, 40 op/s 2021-01-27T09:29:37.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:36.923136+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:37.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:36.924544+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:37.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:37.497126+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:37.535038+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: cluster 2021-01-27T09:29:37.535288+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T09:29:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:37.545151+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[13570]: audit 2021-01-27T09:29:37.558451+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:37.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: cluster 2021-01-27T09:29:36.373921+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v422: 396 pgs: 67 unknown, 329 active+clean; 216 MiB data, 876 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 42 KiB/s wr, 40 op/s 2021-01-27T09:29:37.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:36.923136+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:37.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:36.924544+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:37.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:37.497126+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:37.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:37.535038+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:37.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: cluster 2021-01-27T09:29:37.535288+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T09:29:37.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:37.545151+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:37.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:37 smithi103 bash[9772]: audit 2021-01-27T09:29:37.558451+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:38.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: cluster 2021-01-27T09:29:36.373921+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v422: 396 pgs: 67 unknown, 329 active+clean; 216 MiB data, 876 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 42 KiB/s wr, 40 op/s 2021-01-27T09:29:38.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:36.923136+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:38.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:36.924544+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:29:38.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:37.497126+0000 mon.a (mon.0) 1091 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:38.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:37.535038+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:29:38.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: cluster 2021-01-27T09:29:37.535288+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T09:29:38.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:37.545151+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:38.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:37 smithi047 bash[9721]: audit 2021-01-27T09:29:37.558451+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:29:38.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.443134+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-27T09:29:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.498681+0000 mon.a (mon.0) 1096 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.543244+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:29:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.543700+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-27T09:29:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: cluster 2021-01-27T09:29:38.543838+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T09:29:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.545792+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.103:0/974442815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.546096+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.103:0/1765395338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.548610+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:38.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.549236+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.549573+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.550550+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:38.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.551167+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:38.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[9772]: audit 2021-01-27T09:29:38.553459+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:38.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.443134+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-27T09:29:38.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.498681+0000 mon.a (mon.0) 1096 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:38.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.543244+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:29:38.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.543700+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-27T09:29:38.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: cluster 2021-01-27T09:29:38.543838+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T09:29:38.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.545792+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.103:0/974442815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.546096+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.103:0/1765395338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.548610+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:38.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.549236+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.549573+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:38.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.550550+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:38.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.551167+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:38.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:38 smithi103 bash[13570]: audit 2021-01-27T09:29:38.553459+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:39.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.443134+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-27T09:29:39.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.498681+0000 mon.a (mon.0) 1096 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.543244+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:29:39.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.543700+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi103-32202-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-27T09:29:39.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: cluster 2021-01-27T09:29:38.543838+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T09:29:39.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.545792+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.103:0/974442815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:39.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.546096+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.103:0/1765395338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:39.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.548610+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.549236+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:39.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.549573+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:39.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.550550+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.551167+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:39.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:38 smithi047 bash[9721]: audit 2021-01-27T09:29:38.553459+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]: dispatch 2021-01-27T09:29:39.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: cluster 2021-01-27T09:29:38.375557+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v425: 332 pgs: 332 active+clean; 216 MiB data, 859 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 88 KiB/s wr, 86 op/s 2021-01-27T09:29:39.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.500290+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.501734+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: cluster 2021-01-27T09:29:39.534723+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.543844+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.544110+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.544342+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.544609+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]': finished 2021-01-27T09:29:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.544962+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: cluster 2021-01-27T09:29:39.545167+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T09:29:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.546770+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.548488+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.548939+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.550387+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[9772]: audit 2021-01-27T09:29:39.552604+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: cluster 2021-01-27T09:29:38.375557+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v425: 332 pgs: 332 active+clean; 216 MiB data, 859 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 88 KiB/s wr, 86 op/s 2021-01-27T09:29:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.500290+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.501734+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: cluster 2021-01-27T09:29:39.534723+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:39.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.543844+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:39.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.544110+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:39.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.544342+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:39.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.544609+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]': finished 2021-01-27T09:29:39.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.544962+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:39.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: cluster 2021-01-27T09:29:39.545167+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T09:29:39.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.546770+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.548488+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.548939+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:39.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.550387+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:39.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:39 smithi103 bash[13570]: audit 2021-01-27T09:29:39.552604+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:40.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: cluster 2021-01-27T09:29:38.375557+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v425: 332 pgs: 332 active+clean; 216 MiB data, 859 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 88 KiB/s wr, 86 op/s 2021-01-27T09:29:40.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.500290+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:40.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.501734+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]: dispatch 2021-01-27T09:29:40.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: cluster 2021-01-27T09:29:39.534723+0000 mon.a (mon.0) 1106 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:29:40.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.543844+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:40.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.544110+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:40.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.544342+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:40.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.544609+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-13", "mode": "writeback"}]': finished 2021-01-27T09:29:40.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.544962+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pg_num","val":"11"}]': finished 2021-01-27T09:29:40.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: cluster 2021-01-27T09:29:39.545167+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T09:29:40.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.546770+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.103:0/1080905929' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:40.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.548488+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:40.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.548939+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]: dispatch 2021-01-27T09:29:40.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.550387+0000 mon.a (mon.0) 1115 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:40.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:39 smithi047 bash[9721]: audit 2021-01-27T09:29:39.552604+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-27T09:29:40.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: Running main() from gmock_main.cc 2021-01-27T09:29:40.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2021-01-27T09:29:40.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] Global test environment set-up. 2021-01-27T09:29:40.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2021-01-27T09:29:40.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2021-01-27T09:29:40.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (3070 ms) 2021-01-27T09:29:40.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2021-01-27T09:29:40.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (4266 ms) 2021-01-27T09:29:40.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2021-01-27T09:29:40.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (3330 ms) 2021-01-27T09:29:40.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2021-01-27T09:29:40.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2506 ms) 2021-01-27T09:29:40.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (13172 ms total) 2021-01-27T09:29:40.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: 2021-01-27T09:29:40.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2021-01-27T09:29:40.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2021-01-27T09:29:40.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4136 ms) 2021-01-27T09:29:40.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2021-01-27T09:29:40.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3557 ms) 2021-01-27T09:29:40.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (7693 ms total) 2021-01-27T09:29:40.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: 2021-01-27T09:29:40.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2021-01-27T09:29:40.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2021-01-27T09:29:40.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3969 ms) 2021-01-27T09:29:40.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2021-01-27T09:29:40.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2014 ms) 2021-01-27T09:29:40.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2021-01-27T09:29:40.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1986 ms) 2021-01-27T09:29:40.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2021-01-27T09:29:40.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2035 ms) 2021-01-27T09:29:40.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (10004 ms total) 2021-01-27T09:29:40.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: 2021-01-27T09:29:40.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2021-01-27T09:29:40.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2021-01-27T09:29:40.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (3707 ms) 2021-01-27T09:29:40.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2021-01-27T09:29:40.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3978 ms) 2021-01-27T09:29:40.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (7685 ms total) 2021-01-27T09:29:40.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: 2021-01-27T09:29:40.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [----------] Global test environment tear-down 2021-01-27T09:29:40.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (67497 ms total) 2021-01-27T09:29:40.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots: [ PASSED ] 12 tests. 2021-01-27T09:29:41.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:41 smithi047 bash[9721]: cluster 2021-01-27T09:29:40.520942+0000 mon.a (mon.0) 1117 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:41.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:41 smithi047 bash[9721]: audit 2021-01-27T09:29:40.545920+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:41 smithi047 bash[9721]: audit 2021-01-27T09:29:40.546137+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:41 smithi047 bash[9721]: cluster 2021-01-27T09:29:40.546386+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T09:29:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:41 smithi047 bash[9721]: audit 2021-01-27T09:29:40.547484+0000 mon.a (mon.0) 1121 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:41.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[9772]: cluster 2021-01-27T09:29:40.520942+0000 mon.a (mon.0) 1117 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:41.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[9772]: audit 2021-01-27T09:29:40.545920+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:41.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[9772]: audit 2021-01-27T09:29:40.546137+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:41.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[9772]: cluster 2021-01-27T09:29:40.546386+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T09:29:41.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[9772]: audit 2021-01-27T09:29:40.547484+0000 mon.a (mon.0) 1121 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[13570]: cluster 2021-01-27T09:29:40.520942+0000 mon.a (mon.0) 1117 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[13570]: audit 2021-01-27T09:29:40.545920+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32389-14"}]': finished 2021-01-27T09:29:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[13570]: audit 2021-01-27T09:29:40.546137+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi103-32202-1","var":"pgp_num","val":"11"}]': finished 2021-01-27T09:29:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[13570]: cluster 2021-01-27T09:29:40.546386+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T09:29:41.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:41 smithi103 bash[13570]: audit 2021-01-27T09:29:40.547484+0000 mon.a (mon.0) 1121 : audit [DBG] from='client.? 172.21.15.103:0/1128902641' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-27T09:29:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: cluster 2021-01-27T09:29:40.377449+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v428: 388 pgs: 9 creating+peering, 39 unknown, 340 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 79 KiB/s wr, 85 op/s 2021-01-27T09:29:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.350039+0000 mon.b (mon.2) 55 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.351012+0000 mgr.y (mgr.14138) 539 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.351528+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.352339+0000 mgr.y (mgr.14138) 540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.352806+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.353634+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.354033+0000 mon.b (mon.2) 58 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.354857+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.355164+0000 mon.b (mon.2) 59 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.355958+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.356383+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.357187+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.357526+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.358342+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.358846+0000 mon.b (mon.2) 62 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.359680+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.809 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.360133+0000 mon.b (mon.2) 63 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.810 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.360962+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.810 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.361372+0000 mon.b (mon.2) 64 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.810 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.362206+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.811 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: cluster 2021-01-27T09:29:41.551080+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T09:29:42.811 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.553219+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.812 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.557748+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.812 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.591561+0000 mon.b (mon.2) 65 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.813 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.592455+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.813 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.592840+0000 mon.b (mon.2) 66 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.813 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.593620+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.814 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.593654+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.814 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: audit 2021-01-27T09:29:41.594435+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.815 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:42 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.021767+0000 osd.3 (osd.3) 5 : cluster [DBG] 91.6 scrub ok 2021-01-27T09:29:42.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: cluster 2021-01-27T09:29:40.377449+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v428: 388 pgs: 9 creating+peering, 39 unknown, 340 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 79 KiB/s wr, 85 op/s 2021-01-27T09:29:42.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.350039+0000 mon.b (mon.2) 55 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.351012+0000 mgr.y (mgr.14138) 539 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.351528+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.352339+0000 mgr.y (mgr.14138) 540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.352806+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.353634+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.354033+0000 mon.b (mon.2) 58 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.354857+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.355164+0000 mon.b (mon.2) 59 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.355958+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.356383+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.357187+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.357526+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.358342+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.358846+0000 mon.b (mon.2) 62 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.359680+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.360133+0000 mon.b (mon.2) 63 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.360962+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.361372+0000 mon.b (mon.2) 64 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.362206+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: cluster 2021-01-27T09:29:41.551080+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T09:29:42.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.553219+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.557748+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.591561+0000 mon.b (mon.2) 65 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.592455+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.592840+0000 mon.b (mon.2) 66 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.593620+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.593654+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: audit 2021-01-27T09:29:41.594435+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.021767+0000 osd.3 (osd.3) 5 : cluster [DBG] 91.6 scrub ok 2021-01-27T09:29:42.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: cluster 2021-01-27T09:29:40.377449+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v428: 388 pgs: 9 creating+peering, 39 unknown, 340 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 79 KiB/s wr, 85 op/s 2021-01-27T09:29:42.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.350039+0000 mon.b (mon.2) 55 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.351012+0000 mgr.y (mgr.14138) 539 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.0"}]: dispatch 2021-01-27T09:29:42.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.351528+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.352339+0000 mgr.y (mgr.14138) 540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.1"}]: dispatch 2021-01-27T09:29:42.902 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.352806+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.353634+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.2"}]: dispatch 2021-01-27T09:29:42.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.354033+0000 mon.b (mon.2) 58 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.354857+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.3"}]: dispatch 2021-01-27T09:29:42.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.355164+0000 mon.b (mon.2) 59 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.903 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.355958+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.4"}]: dispatch 2021-01-27T09:29:42.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.356383+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.357187+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.5"}]: dispatch 2021-01-27T09:29:42.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.357526+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.358342+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.6"}]: dispatch 2021-01-27T09:29:42.904 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.358846+0000 mon.b (mon.2) 62 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.359680+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.7"}]: dispatch 2021-01-27T09:29:42.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.360133+0000 mon.b (mon.2) 63 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.360962+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.8"}]: dispatch 2021-01-27T09:29:42.905 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.361372+0000 mon.b (mon.2) 64 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.362206+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "91.9"}]: dispatch 2021-01-27T09:29:42.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: cluster 2021-01-27T09:29:41.551080+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T09:29:42.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.553219+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.557748+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:42.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.591561+0000 mon.b (mon.2) 65 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.592455+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.592840+0000 mon.b (mon.2) 66 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.593620+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.593654+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:42.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: audit 2021-01-27T09:29:41.594435+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:42.908 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:42 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.021767+0000 osd.3 (osd.3) 5 : cluster [DBG] 91.6 scrub ok 2021-01-27T09:29:43.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:41.871607+0000 osd.5 (osd.5) 7 : cluster [DBG] 91.1 scrub ok 2021-01-27T09:29:43.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.045941+0000 osd.1 (osd.1) 3 : cluster [DBG] 91.4 scrub ok 2021-01-27T09:29:43.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.378403+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v431: 356 pgs: 64 unknown, 292 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 23 op/s 2021-01-27T09:29:43.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.440433+0000 osd.4 (osd.4) 3 : cluster [DBG] 91.5 scrub ok 2021-01-27T09:29:43.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: audit 2021-01-27T09:29:42.558500+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:43.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: audit 2021-01-27T09:29:42.558775+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:43.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: audit 2021-01-27T09:29:42.559133+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:43.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.559258+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T09:29:43.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: audit 2021-01-27T09:29:42.565759+0000 mon.b (mon.2) 68 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:43.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: audit 2021-01-27T09:29:42.583551+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:43.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[9772]: cluster 2021-01-27T09:29:43.004954+0000 osd.3 (osd.3) 6 : cluster [DBG] 91.8 scrub ok 2021-01-27T09:29:43.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:41.871607+0000 osd.5 (osd.5) 7 : cluster [DBG] 91.1 scrub ok 2021-01-27T09:29:43.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.045941+0000 osd.1 (osd.1) 3 : cluster [DBG] 91.4 scrub ok 2021-01-27T09:29:43.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.378403+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v431: 356 pgs: 64 unknown, 292 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 23 op/s 2021-01-27T09:29:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.440433+0000 osd.4 (osd.4) 3 : cluster [DBG] 91.5 scrub ok 2021-01-27T09:29:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: audit 2021-01-27T09:29:42.558500+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: audit 2021-01-27T09:29:42.558775+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: audit 2021-01-27T09:29:42.559133+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.559258+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T09:29:43.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: audit 2021-01-27T09:29:42.565759+0000 mon.b (mon.2) 68 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:43.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: audit 2021-01-27T09:29:42.583551+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:43.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:43 smithi103 bash[13570]: cluster 2021-01-27T09:29:43.004954+0000 osd.3 (osd.3) 6 : cluster [DBG] 91.8 scrub ok 2021-01-27T09:29:44.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:41.871607+0000 osd.5 (osd.5) 7 : cluster [DBG] 91.1 scrub ok 2021-01-27T09:29:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.045941+0000 osd.1 (osd.1) 3 : cluster [DBG] 91.4 scrub ok 2021-01-27T09:29:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.378403+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v431: 356 pgs: 64 unknown, 292 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 23 op/s 2021-01-27T09:29:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.440433+0000 osd.4 (osd.4) 3 : cluster [DBG] 91.5 scrub ok 2021-01-27T09:29:44.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: audit 2021-01-27T09:29:42.558500+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? 172.21.15.103:0/4015699221' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: audit 2021-01-27T09:29:42.558775+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.103:0/3193528998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: audit 2021-01-27T09:29:42.559133+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32202-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.559258+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T09:29:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: audit 2021-01-27T09:29:42.565759+0000 mon.b (mon.2) 68 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:44.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: audit 2021-01-27T09:29:42.583551+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:44.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:43 smithi047 bash[9721]: cluster 2021-01-27T09:29:43.004954+0000 osd.3 (osd.3) 6 : cluster [DBG] 91.8 scrub ok 2021-01-27T09:29:44.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[10018]: debug 2021-01-27T09:29:44.139+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:44.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:45.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:44 smithi047 bash[9721]: cluster 2021-01-27T09:29:42.902055+0000 osd.0 (osd.0) 11 : cluster [DBG] 91.0 scrub ok 2021-01-27T09:29:45.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:44 smithi047 bash[9721]: cluster 2021-01-27T09:29:43.136677+0000 osd.6 (osd.6) 7 : cluster [DBG] 91.7 scrub ok 2021-01-27T09:29:45.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:44 smithi047 bash[9721]: cluster 2021-01-27T09:29:44.021296+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T09:29:45.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[13570]: cluster 2021-01-27T09:29:42.902055+0000 osd.0 (osd.0) 11 : cluster [DBG] 91.0 scrub ok 2021-01-27T09:29:45.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[13570]: cluster 2021-01-27T09:29:43.136677+0000 osd.6 (osd.6) 7 : cluster [DBG] 91.7 scrub ok 2021-01-27T09:29:45.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[13570]: cluster 2021-01-27T09:29:44.021296+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T09:29:45.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[9772]: cluster 2021-01-27T09:29:42.902055+0000 osd.0 (osd.0) 11 : cluster [DBG] 91.0 scrub ok 2021-01-27T09:29:45.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[9772]: cluster 2021-01-27T09:29:43.136677+0000 osd.6 (osd.6) 7 : cluster [DBG] 91.7 scrub ok 2021-01-27T09:29:45.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:44 smithi103 bash[9772]: cluster 2021-01-27T09:29:44.021296+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T09:29:46.136 INFO:tasks.workunit.client.0.smithi103.stdout:::4:head 2021-01-27T09:29:46.136 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:d83876eb:::4:head -> 4 2021-01-27T09:29:46.137 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=4 expected=4 2021-01-27T09:29:46.137 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:cfc208b3:::3:head 2021-01-27T09:29:46.137 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:cfc208b3:::3:head expected=25:cfc208b3:::3:head 2021-01-27T09:29:46.137 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:cfc208b3:::3:head -> 3 2021-01-27T09:29:46.137 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=3 expected=3 2021-01-27T09:29:46.138 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:c4fdafeb:::6:head 2021-01-27T09:29:46.138 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:c4fdafeb:::6:head expected=25:c4fdafeb:::6:head 2021-01-27T09:29:46.138 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:c4fdafeb:::6:head -> 6 2021-01-27T09:29:46.138 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=6 expected=6 2021-01-27T09:29:46.139 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:02547ec2:::1:head 2021-01-27T09:29:46.139 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:02547ec2:::1:head expected=25:02547ec2:::1:head 2021-01-27T09:29:46.139 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:02547ec2:::1:head -> 1 2021-01-27T09:29:46.139 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=1 expected=1 2021-01-27T09:29:46.139 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:62a1935d:::14:head 2021-01-27T09:29:46.140 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:62a1935d:::14:head expected=25:62a1935d:::14:head 2021-01-27T09:29:46.140 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:62a1935d:::14:head -> 14 2021-01-27T09:29:46.140 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=14 expected=14 2021-01-27T09:29:46.140 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:5c6b0b28:::7:head 2021-01-27T09:29:46.140 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:5c6b0b28:::7:head expected=25:5c6b0b28:::7:head 2021-01-27T09:29:46.141 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:5c6b0b28:::7:head -> 7 2021-01-27T09:29:46.141 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=7 expected=7 2021-01-27T09:29:46.141 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:566253c9:::13:head 2021-01-27T09:29:46.141 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:566253c9:::13:head expected=25:566253c9:::13:head 2021-01-27T09:29:46.141 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:566253c9:::13:head -> 13 2021-01-27T09:29:46.142 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=13 expected=13 2021-01-27T09:29:46.142 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : seek to 25:52ea6a34:::10:head 2021-01-27T09:29:46.142 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : cursor()=25:52ea6a34:::10:head expected=25:52ea6a34:::10:head 2021-01-27T09:29:46.142 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: > 25:52ea6a34:::10:head -> 10 2021-01-27T09:29:46.142 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: : entry=10 expected=10 2021-01-27T09:29:46.143 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (574 ms) 2021-01-27T09:29:46.143 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2021-01-27T09:29:46.143 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (37556 ms) 2021-01-27T09:29:46.143 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2021-01-27T09:29:46.143 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: split 0/5 -> MIN 25:33333333::::head 2021-01-27T09:29:46.144 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: split 1/5 -> 25:33333333::::head 25:66666666::::head 2021-01-27T09:29:46.144 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: split 2/5 -> 25:66666666::::head 25:99999999::::head 2021-01-27T09:29:46.144 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: split 3/5 -> 25:99999999::::head 25:cccccccc::::head 2021-01-27T09:29:46.144 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: split 4/5 -> 25:cccccccc::::head MAX 2021-01-27T09:29:46.144 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (18482 ms) 2021-01-27T09:29:46.146 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 6 tests from LibRadosList (57387 ms total) 2021-01-27T09:29:46.146 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 2021-01-27T09:29:46.146 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 3 tests from LibRadosListEC 2021-01-27T09:29:46.147 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2021-01-27T09:29:46.147 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1071 ms) 2021-01-27T09:29:46.148 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2021-01-27T09:29:46.148 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo1,foo2,foo3 2021-01-27T09:29:46.148 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo1 2021-01-27T09:29:46.149 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo2 2021-01-27T09:29:46.149 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo3 2021-01-27T09:29:46.149 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo1,foo4,foo5 2021-01-27T09:29:46.150 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo4 2021-01-27T09:29:46.150 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo5 2021-01-27T09:29:46.151 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo1 2021-01-27T09:29:46.152 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset foo6,foo7 2021-01-27T09:29:46.155 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo7 2021-01-27T09:29:46.158 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: foo6 2021-01-27T09:29:46.159 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-01-27T09:29:46.160 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo4 2021-01-27T09:29:46.162 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo5 2021-01-27T09:29:46.163 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns2:foo7 2021-01-27T09:29:46.163 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns2:foo6 2021-01-27T09:29:46.164 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: ns1:foo1 2021-01-27T09:29:46.164 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo1 2021-01-27T09:29:46.165 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo2 2021-01-27T09:29:46.165 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: :foo3 2021-01-27T09:29:46.165 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (76 ms) 2021-01-27T09:29:46.165 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2021-01-27T09:29:46.166 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 1 0 2021-01-27T09:29:46.167 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 10 0 2021-01-27T09:29:46.167 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 13 0 2021-01-27T09:29:46.168 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 7 0 2021-01-27T09:29:46.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: cluster 2021-01-27T09:29:43.441682+0000 osd.4 (osd.4) 4 : cluster [DBG] 91.9 scrub ok 2021-01-27T09:29:46.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: cluster 2021-01-27T09:29:43.542908+0000 osd.2 (osd.2) 5 : cluster [DBG] 91.2 scrub ok 2021-01-27T09:29:46.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.143621+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:46.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: cluster 2021-01-27T09:29:44.379028+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v434: 292 pgs: 292 active+clean; 216 MiB data, 872 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 53 op/s 2021-01-27T09:29:46.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: cluster 2021-01-27T09:29:44.869019+0000 osd.5 (osd.5) 8 : cluster [DBG] 91.3 scrub ok 2021-01-27T09:29:46.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.928062+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:46.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: cluster 2021-01-27T09:29:44.928215+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T09:29:46.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.930183+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.103:0/4167065224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.930968+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.931255+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.103:0/692729810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.932035+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.974044+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.974337+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.974773+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.974997+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.975394+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:46.308 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:45 smithi047 bash[9721]: audit 2021-01-27T09:29:44.975640+0000 mon.a (mon.0) 1140 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:46.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: cluster 2021-01-27T09:29:43.441682+0000 osd.4 (osd.4) 4 : cluster [DBG] 91.9 scrub ok 2021-01-27T09:29:46.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: cluster 2021-01-27T09:29:43.542908+0000 osd.2 (osd.2) 5 : cluster [DBG] 91.2 scrub ok 2021-01-27T09:29:46.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.143621+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:46.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: cluster 2021-01-27T09:29:44.379028+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v434: 292 pgs: 292 active+clean; 216 MiB data, 872 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 53 op/s 2021-01-27T09:29:46.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: cluster 2021-01-27T09:29:44.869019+0000 osd.5 (osd.5) 8 : cluster [DBG] 91.3 scrub ok 2021-01-27T09:29:46.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.928062+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:46.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: cluster 2021-01-27T09:29:44.928215+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T09:29:46.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.930183+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.103:0/4167065224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.930968+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.931255+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.103:0/692729810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.932035+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.974044+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.974337+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.974773+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.974997+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.975394+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:46.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[9772]: audit 2021-01-27T09:29:44.975640+0000 mon.a (mon.0) 1140 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:46.404 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: cluster 2021-01-27T09:29:43.441682+0000 osd.4 (osd.4) 4 : cluster [DBG] 91.9 scrub ok 2021-01-27T09:29:46.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: cluster 2021-01-27T09:29:43.542908+0000 osd.2 (osd.2) 5 : cluster [DBG] 91.2 scrub ok 2021-01-27T09:29:46.406 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.143621+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:46.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: cluster 2021-01-27T09:29:44.379028+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v434: 292 pgs: 292 active+clean; 216 MiB data, 872 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 53 op/s 2021-01-27T09:29:46.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: cluster 2021-01-27T09:29:44.869019+0000 osd.5 (osd.5) 8 : cluster [DBG] 91.3 scrub ok 2021-01-27T09:29:46.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.928062+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32202-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:46.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: cluster 2021-01-27T09:29:44.928215+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T09:29:46.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.930183+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.103:0/4167065224' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.408 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.930968+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.408 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.931255+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.103:0/692729810' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.932035+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:46.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.974044+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.974337+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.974773+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.974997+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:46.410 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.975394+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:46.410 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:45 smithi103 bash[13570]: audit 2021-01-27T09:29:44.975640+0000 mon.a (mon.0) 1140 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:47.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: audit 2021-01-27T09:29:45.938122+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: audit 2021-01-27T09:29:45.938249+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: audit 2021-01-27T09:29:45.938599+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:47.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: cluster 2021-01-27T09:29:45.938705+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T09:29:47.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: audit 2021-01-27T09:29:45.940483+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:47.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[9772]: audit 2021-01-27T09:29:45.944928+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:47.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: audit 2021-01-27T09:29:45.938122+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: audit 2021-01-27T09:29:45.938249+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: audit 2021-01-27T09:29:45.938599+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:47.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: cluster 2021-01-27T09:29:45.938705+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T09:29:47.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: audit 2021-01-27T09:29:45.940483+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:47.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:47 smithi103 bash[13570]: audit 2021-01-27T09:29:45.944928+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:47.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: audit 2021-01-27T09:29:45.938122+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: audit 2021-01-27T09:29:45.938249+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: audit 2021-01-27T09:29:45.938599+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: cluster 2021-01-27T09:29:45.938705+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T09:29:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: audit 2021-01-27T09:29:45.940483+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:47 smithi047 bash[9721]: audit 2021-01-27T09:29:45.944928+0000 mon.a (mon.0) 1145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:29:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: cluster 2021-01-27T09:29:46.379956+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v437: 332 pgs: 72 unknown, 260 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 50 op/s 2021-01-27T09:29:48.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: cluster 2021-01-27T09:29:47.377941+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T09:29:48.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:47.379463+0000 mon.b (mon.2) 69 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:47.380722+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.280812+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:29:48.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.280932+0000 mon.a (mon.0) 1149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:48.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: cluster 2021-01-27T09:29:48.281053+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T09:29:48.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.283093+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.103:0/153433536' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.283212+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.283216+0000 mon.b (mon.2) 70 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.284129+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[9772]: audit 2021-01-27T09:29:48.284824+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: cluster 2021-01-27T09:29:46.379956+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v437: 332 pgs: 72 unknown, 260 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 50 op/s 2021-01-27T09:29:48.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: cluster 2021-01-27T09:29:47.377941+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T09:29:48.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:47.379463+0000 mon.b (mon.2) 69 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:47.380722+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.280812+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:29:48.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.280932+0000 mon.a (mon.0) 1149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:48.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: cluster 2021-01-27T09:29:48.281053+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T09:29:48.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.283093+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.103:0/153433536' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.283212+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.283216+0000 mon.b (mon.2) 70 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.284129+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:48 smithi103 bash[13570]: audit 2021-01-27T09:29:48.284824+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: cluster 2021-01-27T09:29:46.379956+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v437: 332 pgs: 72 unknown, 260 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 50 op/s 2021-01-27T09:29:48.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: cluster 2021-01-27T09:29:47.377941+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T09:29:48.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:47.379463+0000 mon.b (mon.2) 69 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:47.380722+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.280812+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:29:48.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.280932+0000 mon.a (mon.0) 1149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:48.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: cluster 2021-01-27T09:29:48.281053+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T09:29:48.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.283093+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.103:0/153433536' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.283212+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.283216+0000 mon.b (mon.2) 70 : audit [INF] from='client.? 172.21.15.103:0/1894408494' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:48.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.284129+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:48.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:48 smithi047 bash[9721]: audit 2021-01-27T09:29:48.284824+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]: dispatch 2021-01-27T09:29:50.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: cluster 2021-01-27T09:29:48.381591+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v440: 332 pgs: 33 creating+peering, 39 unknown, 260 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 18 op/s 2021-01-27T09:29:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:48.769834+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-27T09:29:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:48.770734+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:48.771282+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.288115+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.288223+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.288292+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:50.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.288588+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: cluster 2021-01-27T09:29:49.288684+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T09:29:50.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.291828+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2"}]: dispatch 2021-01-27T09:29:50.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.292546+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:49 smithi047 bash[9721]: audit 2021-01-27T09:29:49.293991+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: cluster 2021-01-27T09:29:48.381591+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v440: 332 pgs: 33 creating+peering, 39 unknown, 260 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 18 op/s 2021-01-27T09:29:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:48.769834+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-27T09:29:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:48.770734+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:48.771282+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.288115+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.288223+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.288292+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.288588+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: cluster 2021-01-27T09:29:49.288684+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T09:29:50.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.291828+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2"}]: dispatch 2021-01-27T09:29:50.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.292546+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[13570]: audit 2021-01-27T09:29:49.293991+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: cluster 2021-01-27T09:29:48.381591+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v440: 332 pgs: 33 creating+peering, 39 unknown, 260 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 18 op/s 2021-01-27T09:29:50.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:48.769834+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-27T09:29:50.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:48.770734+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:48.771282+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.288115+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.103:0/758535819' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.288223+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.288292+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32202-2"}]': finished 2021-01-27T09:29:50.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.288588+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:50.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: cluster 2021-01-27T09:29:49.288684+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T09:29:50.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.291828+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2"}]: dispatch 2021-01-27T09:29:50.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.292546+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:50.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:49 smithi103 bash[9772]: audit 2021-01-27T09:29:49.293991+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.293194+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:51.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: cluster 2021-01-27T09:29:50.293655+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T09:29:51.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.298318+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.302143+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.303662+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.315372+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: audit 2021-01-27T09:29:50.316097+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[13570]: cluster 2021-01-27T09:29:50.382294+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v443: 300 pgs: 4 creating+peering, 33 unknown, 263 active+clean; 216 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:29:51.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.293194+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:51.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: cluster 2021-01-27T09:29:50.293655+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T09:29:51.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.298318+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.302143+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.303662+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.315372+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: audit 2021-01-27T09:29:50.316097+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:51 smithi103 bash[9772]: cluster 2021-01-27T09:29:50.382294+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v443: 300 pgs: 4 creating+peering, 33 unknown, 263 active+clean; 216 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:29:51.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.293194+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:51.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: cluster 2021-01-27T09:29:50.293655+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T09:29:51.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.298318+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.302143+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.303662+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.315372+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:51.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: audit 2021-01-27T09:29:50.316097+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-27T09:29:51.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:51 smithi047 bash[9721]: cluster 2021-01-27T09:29:50.382294+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v443: 300 pgs: 4 creating+peering, 33 unknown, 263 active+clean; 216 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:29:52.319 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 14 0 2021-01-27T09:29:52.319 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 0 0 2021-01-27T09:29:52.319 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 15 0 2021-01-27T09:29:52.320 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 11 0 2021-01-27T09:29:52.320 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 5 0 2021-01-27T09:29:52.320 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 8 0 2021-01-27T09:29:52.320 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 6 0 2021-01-27T09:29:52.321 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 3 0 2021-01-27T09:29:52.321 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 4 0 2021-01-27T09:29:52.321 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 12 0 2021-01-27T09:29:52.321 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 9 0 2021-01-27T09:29:52.322 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 2 0 2021-01-27T09:29:52.322 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-01-27T09:29:52.322 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (114 ms) 2021-01-27T09:29:52.322 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 3 tests from LibRadosListEC (1261 ms total) 2021-01-27T09:29:52.322 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 2021-01-27T09:29:52.323 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 1 test from LibRadosListNP 2021-01-27T09:29:52.323 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2021-01-27T09:29:52.323 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3022 ms) 2021-01-27T09:29:52.323 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] 1 test from LibRadosListNP (3022 ms total) 2021-01-27T09:29:52.323 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: 2021-01-27T09:29:52.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [----------] Global test environment tear-down 2021-01-27T09:29:52.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [==========] 10 tests from 3 test suites ran. (79328 ms total) 2021-01-27T09:29:52.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_list: [ PASSED ] 10 tests. 2021-01-27T09:29:52.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.309761+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.312944+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:29:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: cluster 2021-01-27T09:29:51.313408+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T09:29:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.316971+0000 mon.b (mon.2) 71 : audit [INF] from='client.? 172.21.15.103:0/2601174505' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.317168+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.103:0/478227449' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.319522+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.321282+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.321707+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.322431+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.352783+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:52.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[9772]: audit 2021-01-27T09:29:51.353395+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.309761+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.312944+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:29:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: cluster 2021-01-27T09:29:51.313408+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T09:29:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.316971+0000 mon.b (mon.2) 71 : audit [INF] from='client.? 172.21.15.103:0/2601174505' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.317168+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.103:0/478227449' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.319522+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.321282+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.321707+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.322431+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.352783+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:52.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:52 smithi103 bash[13570]: audit 2021-01-27T09:29:51.353395+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:52.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.309761+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32202-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.312944+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-27T09:29:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: cluster 2021-01-27T09:29:51.313408+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T09:29:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.316971+0000 mon.b (mon.2) 71 : audit [INF] from='client.? 172.21.15.103:0/2601174505' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.317168+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.103:0/478227449' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.319522+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.321282+0000 mon.a (mon.0) 1168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.321707+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-27T09:29:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.322431+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:52.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.352783+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.103:0/3713595696' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:52.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:52 smithi047 bash[9721]: audit 2021-01-27T09:29:51.353395+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-27T09:29:53.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.310480+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.310695+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:29:53.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.310882+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.311809+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-27T09:29:53.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: cluster 2021-01-27T09:29:52.312153+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T09:29:53.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.337145+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:52.338041+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: cluster 2021-01-27T09:29:52.382863+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v446: 332 pgs: 11 creating+peering, 57 unknown, 264 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:29:53.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: audit 2021-01-27T09:29:53.312330+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:29:53.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[9772]: cluster 2021-01-27T09:29:53.312735+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T09:29:53.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.310480+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.310695+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:29:53.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.310882+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.311809+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-27T09:29:53.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: cluster 2021-01-27T09:29:52.312153+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T09:29:53.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.337145+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:52.338041+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: cluster 2021-01-27T09:29:52.382863+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v446: 332 pgs: 11 creating+peering, 57 unknown, 264 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:29:53.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: audit 2021-01-27T09:29:53.312330+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:29:53.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:53 smithi103 bash[13570]: cluster 2021-01-27T09:29:53.312735+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T09:29:53.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.310480+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.310695+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-27T09:29:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.310882+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.311809+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi103-32202-3","pool2":"test-rados-api-smithi103-32202-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-27T09:29:53.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: cluster 2021-01-27T09:29:52.312153+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T09:29:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.337145+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.103:0/899548608' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:52.338041+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]: dispatch 2021-01-27T09:29:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: cluster 2021-01-27T09:29:52.382863+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v446: 332 pgs: 11 creating+peering, 57 unknown, 264 active+clean; 216 MiB data, 875 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:29:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: audit 2021-01-27T09:29:53.312330+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi103-32296-1","app":"app1","key":"key1"}]': finished 2021-01-27T09:29:53.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:53 smithi047 bash[9721]: cluster 2021-01-27T09:29:53.312735+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T09:29:54.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2021-01-27T09:29:54.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] Global test environment set-up. 2021-01-27T09:29:54.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2021-01-27T09:29:54.324 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2021-01-27T09:29:54.325 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2021-01-27T09:29:54.325 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-01-27T09:29:54.325 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:29:54.325 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2021-01-27T09:29:54.325 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: seed 32296 2021-01-27T09:29:54.326 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2021-01-27T09:29:54.326 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2021-01-27T09:29:54.326 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2021-01-27T09:29:54.326 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (444 ms) 2021-01-27T09:29:54.326 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2021-01-27T09:29:54.327 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (22 ms) 2021-01-27T09:29:54.327 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2021-01-27T09:29:54.327 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (14 ms) 2021-01-27T09:29:54.327 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2021-01-27T09:29:54.327 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (10 ms) 2021-01-27T09:29:54.328 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2021-01-27T09:29:54.328 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (4 ms) 2021-01-27T09:29:54.328 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2021-01-27T09:29:54.328 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2021-01-27T09:29:54.329 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2021-01-27T09:29:54.329 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (6 ms) 2021-01-27T09:29:54.329 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2021-01-27T09:29:54.329 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (3 ms) 2021-01-27T09:29:54.329 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2021-01-27T09:29:54.330 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (13 ms) 2021-01-27T09:29:54.331 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2021-01-27T09:29:54.331 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (4 ms) 2021-01-27T09:29:54.331 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2021-01-27T09:29:54.331 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (6 ms) 2021-01-27T09:29:54.332 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2021-01-27T09:29:54.332 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (12 ms) 2021-01-27T09:29:54.332 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2021-01-27T09:29:54.332 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: osd_max_attr_size = 0 2021-01-27T09:29:54.333 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2021-01-27T09:29:54.333 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (3149 ms) 2021-01-27T09:29:54.333 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2021-01-27T09:29:54.333 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (438 ms) 2021-01-27T09:29:54.333 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2021-01-27T09:29:54.334 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: waiting for initial deep scrubs... 2021-01-27T09:29:54.334 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: done waiting, doing copies 2021-01-27T09:29:54.334 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: waiting for final deep scrubs... 2021-01-27T09:29:54.334 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: done waiting 2021-01-27T09:29:54.334 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60851 ms) 2021-01-27T09:29:54.335 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2021-01-27T09:29:54.335 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (11 ms) 2021-01-27T09:29:54.335 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2021-01-27T09:29:54.335 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (7 ms) 2021-01-27T09:29:54.335 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2021-01-27T09:29:54.336 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4547 ms) 2021-01-27T09:29:54.336 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2021-01-27T09:29:54.336 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2021-01-27T09:29:54.336 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2021-01-27T09:29:54.336 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2021-01-27T09:29:54.337 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2021-01-27T09:29:54.337 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2021-01-27T09:29:54.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:29:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: cluster 2021-01-27T09:29:53.323100+0000 mon.a (mon.0) 1180 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: audit 2021-01-27T09:29:54.154927+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: cluster 2021-01-27T09:29:54.321823+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T09:29:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: audit 2021-01-27T09:29:54.323787+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.103:0/1982570781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: audit 2021-01-27T09:29:54.327585+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:54 smithi047 bash[9721]: audit 2021-01-27T09:29:54.328982+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[10018]: debug 2021-01-27T09:29:54.150+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:29:54.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: cluster 2021-01-27T09:29:53.323100+0000 mon.a (mon.0) 1180 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:54.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: audit 2021-01-27T09:29:54.154927+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:54.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: cluster 2021-01-27T09:29:54.321823+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T09:29:54.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: audit 2021-01-27T09:29:54.323787+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.103:0/1982570781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: audit 2021-01-27T09:29:54.327585+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[9772]: audit 2021-01-27T09:29:54.328982+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: cluster 2021-01-27T09:29:53.323100+0000 mon.a (mon.0) 1180 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:29:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: audit 2021-01-27T09:29:54.154927+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:29:54.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: cluster 2021-01-27T09:29:54.321823+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T09:29:54.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: audit 2021-01-27T09:29:54.323787+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.103:0/1982570781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: audit 2021-01-27T09:29:54.327585+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:54.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:54 smithi103 bash[13570]: audit 2021-01-27T09:29:54.328982+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:55.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.360944+0000 mon.b (mon.2) 72 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.361946+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.363402+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.364300+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.364343+0000 mon.b (mon.2) 74 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:54.365200+0000 mon.a (mon.0) 1186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: cluster 2021-01-27T09:29:54.383495+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v449: 300 pgs: 64 unknown, 236 active+clean; 33 KiB data, 881 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:55.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:55.321243+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:55.321474+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:55.322042+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: cluster 2021-01-27T09:29:55.322236+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T09:29:55.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:55.323914+0000 mon.b (mon.2) 75 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[13570]: audit 2021-01-27T09:29:55.328358+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.360944+0000 mon.b (mon.2) 72 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.361946+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.363402+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.364300+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.364343+0000 mon.b (mon.2) 74 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:54.365200+0000 mon.a (mon.0) 1186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: cluster 2021-01-27T09:29:54.383495+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v449: 300 pgs: 64 unknown, 236 active+clean; 33 KiB data, 881 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:55.321243+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:55.321474+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:55.322042+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:55.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: cluster 2021-01-27T09:29:55.322236+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T09:29:55.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:55.323914+0000 mon.b (mon.2) 75 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:55 smithi103 bash[9772]: audit 2021-01-27T09:29:55.328358+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.360944+0000 mon.b (mon.2) 72 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.361946+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.363402+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.364300+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.364343+0000 mon.b (mon.2) 74 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:54.365200+0000 mon.a (mon.0) 1186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:29:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: cluster 2021-01-27T09:29:54.383495+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v449: 300 pgs: 64 unknown, 236 active+clean; 33 KiB data, 881 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:55.321243+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:55.321474+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? 172.21.15.103:0/3605504681' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:29:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:55.322042+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:29:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: cluster 2021-01-27T09:29:55.322236+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T09:29:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:55.323914+0000 mon.b (mon.2) 75 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:55 smithi047 bash[9721]: audit 2021-01-27T09:29:55.328358+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:29:58.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:57 smithi047 bash[9721]: cluster 2021-01-27T09:29:56.751139+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T09:29:58.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:57 smithi103 bash[9772]: cluster 2021-01-27T09:29:56.751139+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T09:29:58.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:57 smithi103 bash[13570]: cluster 2021-01-27T09:29:56.751139+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T09:29:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: cluster 2021-01-27T09:29:56.384286+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v452: 236 pgs: 236 active+clean; 33 KiB data, 886 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: audit 2021-01-27T09:29:57.660564+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:29:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: cluster 2021-01-27T09:29:57.660732+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T09:29:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: audit 2021-01-27T09:29:57.665639+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.103:0/4229454358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: audit 2021-01-27T09:29:57.667195+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.103:0/834789283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: audit 2021-01-27T09:29:57.667927+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:58 smithi047 bash[9721]: audit 2021-01-27T09:29:57.668238+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: cluster 2021-01-27T09:29:56.384286+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v452: 236 pgs: 236 active+clean; 33 KiB data, 886 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:59.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: audit 2021-01-27T09:29:57.660564+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:29:59.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: cluster 2021-01-27T09:29:57.660732+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T09:29:59.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: audit 2021-01-27T09:29:57.665639+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.103:0/4229454358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: audit 2021-01-27T09:29:57.667195+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.103:0/834789283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: audit 2021-01-27T09:29:57.667927+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[13570]: audit 2021-01-27T09:29:57.668238+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: cluster 2021-01-27T09:29:56.384286+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v452: 236 pgs: 236 active+clean; 33 KiB data, 886 MiB used, 714 GiB / 715 GiB avail 2021-01-27T09:29:59.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: audit 2021-01-27T09:29:57.660564+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:29:59.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: cluster 2021-01-27T09:29:57.660732+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T09:29:59.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: audit 2021-01-27T09:29:57.665639+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.103:0/4229454358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: audit 2021-01-27T09:29:57.667195+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.103:0/834789283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: audit 2021-01-27T09:29:57.667927+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:29:59.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:58 smithi103 bash[9772]: audit 2021-01-27T09:29:57.668238+0000 mon.a (mon.0) 1196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: cluster 2021-01-27T09:29:58.385792+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v454: 308 pgs: 35 creating+peering, 37 unknown, 236 active+clean; 33 KiB data, 508 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 503 B/s wr, 1 op/s 2021-01-27T09:30:00.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.675705+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.675891+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: cluster 2021-01-27T09:29:58.676303+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T09:30:00.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.678148+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:30:00.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.678303+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.678585+0000 mon.b (mon.2) 76 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.679690+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.683082+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:29:59 smithi047 bash[9721]: audit 2021-01-27T09:29:58.690834+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:30:00.143 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: cluster 2021-01-27T09:29:58.385792+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v454: 308 pgs: 35 creating+peering, 37 unknown, 236 active+clean; 33 KiB data, 508 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 503 B/s wr, 1 op/s 2021-01-27T09:30:00.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.675705+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.675891+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: cluster 2021-01-27T09:29:58.676303+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T09:30:00.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.678148+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:30:00.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.678303+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.678585+0000 mon.b (mon.2) 76 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.679690+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.683082+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[9772]: audit 2021-01-27T09:29:58.690834+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:30:00.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: cluster 2021-01-27T09:29:58.385792+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v454: 308 pgs: 35 creating+peering, 37 unknown, 236 active+clean; 33 KiB data, 508 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 503 B/s wr, 1 op/s 2021-01-27T09:30:00.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.675705+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.675891+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:00.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: cluster 2021-01-27T09:29:58.676303+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T09:30:00.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.678148+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:30:00.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.678303+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.678585+0000 mon.b (mon.2) 76 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.679690+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:00.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.683082+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:00.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:29:59 smithi103 bash[13570]: audit 2021-01-27T09:29:58.690834+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:30:01.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.679511+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.679666+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: cluster 2021-01-27T09:29:59.680610+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T09:30:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.685812+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.688508+0000 mon.b (mon.2) 77 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.691251+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:00 smithi047 bash[9721]: audit 2021-01-27T09:29:59.705582+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:01.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.679511+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:01.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.679666+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:01.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: cluster 2021-01-27T09:29:59.680610+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T09:30:01.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.685812+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.688508+0000 mon.b (mon.2) 77 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:01.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.691251+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[13570]: audit 2021-01-27T09:29:59.705582+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:01.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.679511+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:01.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.679666+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:01.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: cluster 2021-01-27T09:29:59.680610+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T09:30:01.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.685812+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.103:0/3367111261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.688508+0000 mon.b (mon.2) 77 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:01.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.691251+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]: dispatch 2021-01-27T09:30:01.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:00 smithi103 bash[9772]: audit 2021-01-27T09:29:59.705582+0000 mon.a (mon.0) 1208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279362+0000 mon.a (mon.0) 1209 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279408+0000 mon.a (mon.0) 1210 : cluster [WRN] [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-01-27T09:30:02.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279432+0000 mon.a (mon.0) 1211 : cluster [WRN] pool 'test-rados-api-smithi103-32354-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-01-27T09:30:02.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279446+0000 mon.a (mon.0) 1212 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279472+0000 mon.a (mon.0) 1213 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2021-01-27T09:30:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279495+0000 mon.a (mon.0) 1214 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi103-32406-14' 2021-01-27T09:30:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.279531+0000 mon.a (mon.0) 1215 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-01-27T09:30:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.386831+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v457: 268 pgs: 8 creating+peering, 23 unknown, 237 active+clean; 33 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2021-01-27T09:30:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.722803+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.722926+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.723098+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T09:30:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.726198+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.103:0/2288210902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.727948+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.743353+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: cluster 2021-01-27T09:30:00.764604+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:02.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.766254+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.769470+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.770385+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.770706+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.771236+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:02.056 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:01 smithi047 bash[9721]: audit 2021-01-27T09:30:00.771534+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:02.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279362+0000 mon.a (mon.0) 1209 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279408+0000 mon.a (mon.0) 1210 : cluster [WRN] [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-01-27T09:30:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279432+0000 mon.a (mon.0) 1211 : cluster [WRN] pool 'test-rados-api-smithi103-32354-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-01-27T09:30:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279446+0000 mon.a (mon.0) 1212 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279472+0000 mon.a (mon.0) 1213 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2021-01-27T09:30:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279495+0000 mon.a (mon.0) 1214 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi103-32406-14' 2021-01-27T09:30:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.279531+0000 mon.a (mon.0) 1215 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-01-27T09:30:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.386831+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v457: 268 pgs: 8 creating+peering, 23 unknown, 237 active+clean; 33 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2021-01-27T09:30:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.722803+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.722926+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.723098+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T09:30:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.726198+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.103:0/2288210902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.727948+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.743353+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: cluster 2021-01-27T09:30:00.764604+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:02.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.766254+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.769470+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.770385+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.770706+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.771236+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:02.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[9772]: audit 2021-01-27T09:30:00.771534+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:02.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279362+0000 mon.a (mon.0) 1209 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279408+0000 mon.a (mon.0) 1210 : cluster [WRN] [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-01-27T09:30:02.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279432+0000 mon.a (mon.0) 1211 : cluster [WRN] pool 'test-rados-api-smithi103-32354-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-01-27T09:30:02.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279446+0000 mon.a (mon.0) 1212 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-01-27T09:30:02.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279472+0000 mon.a (mon.0) 1213 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2021-01-27T09:30:02.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279495+0000 mon.a (mon.0) 1214 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi103-32406-14' 2021-01-27T09:30:02.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.279531+0000 mon.a (mon.0) 1215 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-01-27T09:30:02.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.386831+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v457: 268 pgs: 8 creating+peering, 23 unknown, 237 active+clean; 33 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2021-01-27T09:30:02.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.722803+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-14"}]': finished 2021-01-27T09:30:02.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.722926+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:02.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.723098+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T09:30:02.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.726198+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.103:0/2288210902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.727948+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.743353+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:02.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: cluster 2021-01-27T09:30:00.764604+0000 mon.a (mon.0) 1221 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:02.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.766254+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.769470+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.770385+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.770706+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:02.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.771236+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:02.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:01 smithi103 bash[13570]: audit 2021-01-27T09:30:00.771534+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:03.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: audit 2021-01-27T09:30:01.727758+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: audit 2021-01-27T09:30:01.728495+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: audit 2021-01-27T09:30:01.730801+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: cluster 2021-01-27T09:30:01.731001+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T09:30:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: audit 2021-01-27T09:30:01.732317+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:03 smithi047 bash[9721]: audit 2021-01-27T09:30:01.734348+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:03.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: audit 2021-01-27T09:30:01.727758+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: audit 2021-01-27T09:30:01.728495+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: audit 2021-01-27T09:30:01.730801+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: cluster 2021-01-27T09:30:01.731001+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T09:30:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: audit 2021-01-27T09:30:01.732317+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:03.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[13570]: audit 2021-01-27T09:30:01.734348+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:03.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: audit 2021-01-27T09:30:01.727758+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? 172.21.15.103:0/188553912' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: audit 2021-01-27T09:30:01.728495+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:03.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: audit 2021-01-27T09:30:01.730801+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32406-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: cluster 2021-01-27T09:30:01.731001+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T09:30:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: audit 2021-01-27T09:30:01.732317+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:03 smithi103 bash[9772]: audit 2021-01-27T09:30:01.734348+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:04.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: cluster 2021-01-27T09:30:02.387744+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v460: 300 pgs: 14 creating+peering, 54 unknown, 232 active+clean; 33 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: cluster 2021-01-27T09:30:03.149744+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T09:30:04.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:03.151245+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:03.152509+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.029733+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.029840+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:04.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: cluster 2021-01-27T09:30:04.029989+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T09:30:04.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.031696+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.103:0/652897165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.032116+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.103:0/1804819635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.032388+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.033505+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.038110+0000 mon.b (mon.2) 79 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:04 smithi047 bash[9721]: audit 2021-01-27T09:30:04.039352+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[10018]: debug 2021-01-27T09:30:04.158+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:04.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: cluster 2021-01-27T09:30:02.387744+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v460: 300 pgs: 14 creating+peering, 54 unknown, 232 active+clean; 33 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:04.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: cluster 2021-01-27T09:30:03.149744+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T09:30:04.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:03.151245+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:03.152509+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.029733+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:04.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.029840+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:04.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: cluster 2021-01-27T09:30:04.029989+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T09:30:04.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.031696+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.103:0/652897165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.032116+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.103:0/1804819635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.032388+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.033505+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.038110+0000 mon.b (mon.2) 79 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[13570]: audit 2021-01-27T09:30:04.039352+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: cluster 2021-01-27T09:30:02.387744+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v460: 300 pgs: 14 creating+peering, 54 unknown, 232 active+clean; 33 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:04.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: cluster 2021-01-27T09:30:03.149744+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T09:30:04.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:03.151245+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:03.152509+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.029733+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32406-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:04.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.029840+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:04.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: cluster 2021-01-27T09:30:04.029989+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T09:30:04.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.031696+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.103:0/652897165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.032116+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.103:0/1804819635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.032388+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.033505+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:04.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.038110+0000 mon.b (mon.2) 79 : audit [INF] from='client.? 172.21.15.103:0/4229314388' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:04.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:04 smithi103 bash[9772]: audit 2021-01-27T09:30:04.039352+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]: dispatch 2021-01-27T09:30:05.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:05 smithi047 bash[9721]: audit 2021-01-27T09:30:04.164336+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:05.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:05 smithi047 bash[9721]: audit 2021-01-27T09:30:05.037249+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:05 smithi047 bash[9721]: audit 2021-01-27T09:30:05.037385+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:05 smithi047 bash[9721]: audit 2021-01-27T09:30:05.037571+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:05.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:05 smithi047 bash[9721]: cluster 2021-01-27T09:30:05.037891+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T09:30:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[9772]: audit 2021-01-27T09:30:04.164336+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[9772]: audit 2021-01-27T09:30:05.037249+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[9772]: audit 2021-01-27T09:30:05.037385+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[9772]: audit 2021-01-27T09:30:05.037571+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:05.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[9772]: cluster 2021-01-27T09:30:05.037891+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T09:30:05.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[13570]: audit 2021-01-27T09:30:04.164336+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:05.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[13570]: audit 2021-01-27T09:30:05.037249+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32164-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[13570]: audit 2021-01-27T09:30:05.037385+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:05.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[13570]: audit 2021-01-27T09:30:05.037571+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-24"}]': finished 2021-01-27T09:30:05.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:05 smithi103 bash[13570]: cluster 2021-01-27T09:30:05.037891+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T09:30:06.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: cluster 2021-01-27T09:30:04.388670+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v463: 300 pgs: 72 unknown, 228 active+clean; 33 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:06.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: cluster 2021-01-27T09:30:06.039558+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T09:30:06.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.043425+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.103:0/3413320241' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.045502+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.082839+0000 mon.b (mon.2) 80 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.083862+0000 mon.a (mon.0) 1244 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.084065+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.085958+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.086109+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:06.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:06 smithi047 bash[9721]: audit 2021-01-27T09:30:06.501054+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:06.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: cluster 2021-01-27T09:30:04.388670+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v463: 300 pgs: 72 unknown, 228 active+clean; 33 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:06.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: cluster 2021-01-27T09:30:06.039558+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T09:30:06.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.043425+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.103:0/3413320241' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.045502+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.082839+0000 mon.b (mon.2) 80 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.083862+0000 mon.a (mon.0) 1244 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.084065+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.085958+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.086109+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:06.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[9772]: audit 2021-01-27T09:30:06.501054+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:06.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: cluster 2021-01-27T09:30:04.388670+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v463: 300 pgs: 72 unknown, 228 active+clean; 33 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:06.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: cluster 2021-01-27T09:30:06.039558+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T09:30:06.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.043425+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.103:0/3413320241' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.045502+0000 mon.a (mon.0) 1243 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:06.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.082839+0000 mon.b (mon.2) 80 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.083862+0000 mon.a (mon.0) 1244 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.084065+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.085958+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:06.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.086109+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:06.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:06 smithi103 bash[13570]: audit 2021-01-27T09:30:06.501054+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:08.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: cluster 2021-01-27T09:30:06.389340+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v466: 268 pgs: 3 creating+peering, 37 unknown, 228 active+clean; 33 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:08.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.047581+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:08.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.048095+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:08.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: cluster 2021-01-27T09:30:07.048250+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T09:30:08.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.053691+0000 mon.b (mon.2) 83 : audit [INF] from='client.? 172.21.15.103:0/1790556916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.054746+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:08.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.059770+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:08 smithi047 bash[9721]: audit 2021-01-27T09:30:07.060574+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:08.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: cluster 2021-01-27T09:30:06.389340+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v466: 268 pgs: 3 creating+peering, 37 unknown, 228 active+clean; 33 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:08.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.047581+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:08.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.048095+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:08.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: cluster 2021-01-27T09:30:07.048250+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T09:30:08.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.053691+0000 mon.b (mon.2) 83 : audit [INF] from='client.? 172.21.15.103:0/1790556916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.054746+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:08.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.059770+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[13570]: audit 2021-01-27T09:30:07.060574+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:08.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: cluster 2021-01-27T09:30:06.389340+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v466: 268 pgs: 3 creating+peering, 37 unknown, 228 active+clean; 33 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.047581+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.048095+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: cluster 2021-01-27T09:30:07.048250+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T09:30:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.053691+0000 mon.b (mon.2) 83 : audit [INF] from='client.? 172.21.15.103:0/1790556916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.054746+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.059770+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:08.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:08 smithi103 bash[9772]: audit 2021-01-27T09:30:07.060574+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:09.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:09 smithi103 bash[13570]: audit 2021-01-27T09:30:08.057753+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:09.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:09 smithi103 bash[13570]: cluster 2021-01-27T09:30:08.488159+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T09:30:09.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:09 smithi103 bash[9772]: audit 2021-01-27T09:30:08.057753+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:09.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:09 smithi103 bash[9772]: cluster 2021-01-27T09:30:08.488159+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T09:30:09.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:09 smithi047 bash[9721]: audit 2021-01-27T09:30:08.057753+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:09.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:09 smithi047 bash[9721]: cluster 2021-01-27T09:30:08.488159+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T09:30:10.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[9772]: cluster 2021-01-27T09:30:08.390694+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v469: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 33 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:30:10.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[9772]: audit 2021-01-27T09:30:09.072835+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:10.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[9772]: cluster 2021-01-27T09:30:09.073104+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T09:30:10.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[9772]: audit 2021-01-27T09:30:09.076608+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.103:0/2772150989' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:10.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[9772]: audit 2021-01-27T09:30:09.077970+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:10.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[13570]: cluster 2021-01-27T09:30:08.390694+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v469: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 33 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:30:10.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[13570]: audit 2021-01-27T09:30:09.072835+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:10.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[13570]: cluster 2021-01-27T09:30:09.073104+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T09:30:10.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[13570]: audit 2021-01-27T09:30:09.076608+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.103:0/2772150989' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:10.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:10 smithi103 bash[13570]: audit 2021-01-27T09:30:09.077970+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:10.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:10 smithi047 bash[9721]: cluster 2021-01-27T09:30:08.390694+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v469: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 33 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:30:10.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:10 smithi047 bash[9721]: audit 2021-01-27T09:30:09.072835+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:10.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:10 smithi047 bash[9721]: cluster 2021-01-27T09:30:09.073104+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T09:30:10.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:10 smithi047 bash[9721]: audit 2021-01-27T09:30:09.076608+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.103:0/2772150989' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:10.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:10 smithi047 bash[9721]: audit 2021-01-27T09:30:09.077970+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:10.078965+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: cluster 2021-01-27T09:30:10.079932+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T09:30:11.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:10.083680+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.103:0/4013175609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:10.086818+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:11.079833+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: cluster 2021-01-27T09:30:11.080576+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T09:30:11.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:11.088216+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:11.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[13570]: audit 2021-01-27T09:30:11.091043+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:11.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:10.078965+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: cluster 2021-01-27T09:30:10.079932+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T09:30:11.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:10.083680+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.103:0/4013175609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:10.086818+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:11.079833+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: cluster 2021-01-27T09:30:11.080576+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T09:30:11.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:11.088216+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:11.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:11 smithi103 bash[9772]: audit 2021-01-27T09:30:11.091043+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:11.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:10.078965+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: cluster 2021-01-27T09:30:10.079932+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T09:30:11.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:10.083680+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.103:0/4013175609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:10.086818+0000 mon.a (mon.0) 1259 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:11.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:11.079833+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:11.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: cluster 2021-01-27T09:30:11.080576+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T09:30:11.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:11.088216+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:11.558 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:11 smithi047 bash[9721]: audit 2021-01-27T09:30:11.091043+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: cluster 2021-01-27T09:30:10.391653+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v472: 308 pgs: 15 creating+peering, 57 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-01-27T09:30:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: cluster 2021-01-27T09:30:11.099025+0000 mon.a (mon.0) 1263 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: audit 2021-01-27T09:30:12.084984+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: cluster 2021-01-27T09:30:12.085404+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T09:30:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: audit 2021-01-27T09:30:12.089038+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: audit 2021-01-27T09:30:12.092167+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.103:0/1856762328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: audit 2021-01-27T09:30:12.098519+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[13570]: audit 2021-01-27T09:30:12.099274+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: cluster 2021-01-27T09:30:10.391653+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v472: 308 pgs: 15 creating+peering, 57 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-01-27T09:30:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: cluster 2021-01-27T09:30:11.099025+0000 mon.a (mon.0) 1263 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: audit 2021-01-27T09:30:12.084984+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: cluster 2021-01-27T09:30:12.085404+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T09:30:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: audit 2021-01-27T09:30:12.089038+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: audit 2021-01-27T09:30:12.092167+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.103:0/1856762328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: audit 2021-01-27T09:30:12.098519+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:12 smithi103 bash[9772]: audit 2021-01-27T09:30:12.099274+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:12.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: cluster 2021-01-27T09:30:10.391653+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v472: 308 pgs: 15 creating+peering, 57 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2021-01-27T09:30:12.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: cluster 2021-01-27T09:30:11.099025+0000 mon.a (mon.0) 1263 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:12.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: audit 2021-01-27T09:30:12.084984+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:12.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: cluster 2021-01-27T09:30:12.085404+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T09:30:12.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: audit 2021-01-27T09:30:12.089038+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.103:0/338974991' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: audit 2021-01-27T09:30:12.092167+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.103:0/1856762328' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:12.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: audit 2021-01-27T09:30:12.098519+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]: dispatch 2021-01-27T09:30:12.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:12 smithi047 bash[9721]: audit 2021-01-27T09:30:12.099274+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[10018]: debug 2021-01-27T09:30:14.166+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:14.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: cluster 2021-01-27T09:30:12.392537+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v475: 268 pgs: 32 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 9.7 KiB/s wr, 2 op/s 2021-01-27T09:30:14.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.093215+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:14.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.093594+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: cluster 2021-01-27T09:30:13.093904+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T09:30:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.107557+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.103:0/2928432671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.108560+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.152581+0000 mon.b (mon.2) 87 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.154008+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.158310+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.159737+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.161519+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[13570]: audit 2021-01-27T09:30:13.162641+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:14.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: cluster 2021-01-27T09:30:12.392537+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v475: 268 pgs: 32 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 9.7 KiB/s wr, 2 op/s 2021-01-27T09:30:14.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.093215+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:14.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.093594+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:14.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: cluster 2021-01-27T09:30:13.093904+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T09:30:14.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.107557+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.103:0/2928432671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.108560+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.152581+0000 mon.b (mon.2) 87 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.154008+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.158310+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.159737+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.161519+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:14.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:14 smithi103 bash[9772]: audit 2021-01-27T09:30:13.162641+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:14.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: cluster 2021-01-27T09:30:12.392537+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v475: 268 pgs: 32 unknown, 236 active+clean; 57 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 9.7 KiB/s wr, 2 op/s 2021-01-27T09:30:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.093215+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-25"}]': finished 2021-01-27T09:30:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.093594+0000 mon.a (mon.0) 1269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32296-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: cluster 2021-01-27T09:30:13.093904+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T09:30:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.107557+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.103:0/2928432671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.108560+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.152581+0000 mon.b (mon.2) 87 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.154008+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.158310+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.159737+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:14.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.161519+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:14.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:14 smithi047 bash[9721]: audit 2021-01-27T09:30:13.162641+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.548 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[15060]: debug 2021-01-27T09:30:15.172+0000 7f5d26412700 -1 osd.5 pg_epoch: 151 pg[117.7s0( v 150'3 (0'0,150'3] local-lis/les=140/141 n=2 ec=140/140 lis/c=140/140 les/c/f=141/141/0 sis=140) [5,6,7]p5(0) r=0 lpr=140 crt=150'3 lcod 149'1 mlcod 149'1 active+clean+snaptrim trimq=[b~1] ps=[2~2,6~2]] removing snap head 2021-01-27T09:30:15.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.100955+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:15.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.101178+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:15.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: cluster 2021-01-27T09:30:14.101295+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T09:30:15.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.106238+0000 mon.b (mon.2) 90 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.111445+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.150243+0000 mon.b (mon.2) 91 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.151473+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.153866+0000 mon.b (mon.2) 92 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.155124+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.156835+0000 mon.b (mon.2) 93 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.157984+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:15 smithi047 bash[9721]: audit 2021-01-27T09:30:14.172467+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:15.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.100955+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:15.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.101178+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:15.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: cluster 2021-01-27T09:30:14.101295+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T09:30:15.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.106238+0000 mon.b (mon.2) 90 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.111445+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.150243+0000 mon.b (mon.2) 91 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.151473+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.153866+0000 mon.b (mon.2) 92 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.155124+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.906 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.156835+0000 mon.b (mon.2) 93 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.157984+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.907 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[13570]: audit 2021-01-27T09:30:14.172467+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:15.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.100955+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:15.907 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.101178+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: cluster 2021-01-27T09:30:14.101295+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.106238+0000 mon.b (mon.2) 90 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.111445+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.150243+0000 mon.b (mon.2) 91 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.908 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.151473+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.153866+0000 mon.b (mon.2) 92 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.155124+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:15.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.156835+0000 mon.b (mon.2) 93 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.157984+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:15.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:15 smithi103 bash[9772]: audit 2021-01-27T09:30:14.172467+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:16.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: cluster 2021-01-27T09:30:14.393458+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v478: 268 pgs: 12 creating+peering, 20 unknown, 236 active+clean; 64 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2021-01-27T09:30:16.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:15.543738+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:16.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: cluster 2021-01-27T09:30:15.543837+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T09:30:16.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:15.544647+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:15.546312+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:15.861382+0000 mon.b (mon.2) 95 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:16.009139+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:16.016286+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:16.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: cluster 2021-01-27T09:30:16.419556+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T09:30:16.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:16 smithi047 bash[9721]: audit 2021-01-27T09:30:16.431383+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:16.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: cluster 2021-01-27T09:30:14.393458+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v478: 268 pgs: 12 creating+peering, 20 unknown, 236 active+clean; 64 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2021-01-27T09:30:16.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:15.543738+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:16.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: cluster 2021-01-27T09:30:15.543837+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T09:30:16.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:15.544647+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:15.546312+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:15.861382+0000 mon.b (mon.2) 95 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:16.009139+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:16.016286+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:16.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: cluster 2021-01-27T09:30:16.419556+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T09:30:16.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[9772]: audit 2021-01-27T09:30:16.431383+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:16.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: cluster 2021-01-27T09:30:14.393458+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v478: 268 pgs: 12 creating+peering, 20 unknown, 236 active+clean; 64 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 0 op/s 2021-01-27T09:30:16.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:15.543738+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32296-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:16.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: cluster 2021-01-27T09:30:15.543837+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T09:30:16.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:15.544647+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:15.546312+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:16.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:15.861382+0000 mon.b (mon.2) 95 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:16.009139+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:16.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:16.016286+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:16.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: cluster 2021-01-27T09:30:16.419556+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T09:30:16.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:16 smithi103 bash[13570]: audit 2021-01-27T09:30:16.431383+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:18.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: cluster 2021-01-27T09:30:16.394215+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v481: 276 pgs: 40 unknown, 236 active+clean; 62 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-27T09:30:18.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.026460+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:18.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.026567+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:18.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.026952+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:18.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: cluster 2021-01-27T09:30:17.027042+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T09:30:18.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.031875+0000 mon.b (mon.2) 96 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.035476+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.038249+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:18.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:18 smithi047 bash[9721]: audit 2021-01-27T09:30:17.038840+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:18.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: cluster 2021-01-27T09:30:16.394215+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v481: 276 pgs: 40 unknown, 236 active+clean; 62 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-27T09:30:18.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.026460+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:18.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.026567+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:18.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.026952+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:18.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: cluster 2021-01-27T09:30:17.027042+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T09:30:18.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.031875+0000 mon.b (mon.2) 96 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.035476+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.038249+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:18.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[9772]: audit 2021-01-27T09:30:17.038840+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:18.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: cluster 2021-01-27T09:30:16.394215+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v481: 276 pgs: 40 unknown, 236 active+clean; 62 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-27T09:30:18.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.026460+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32296-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:18.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.026567+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:18.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.026952+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.103:0/433531300' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:18.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: cluster 2021-01-27T09:30:17.027042+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T09:30:18.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.031875+0000 mon.b (mon.2) 96 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.035476+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]: dispatch 2021-01-27T09:30:18.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.038249+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:18.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:18 smithi103 bash[13570]: audit 2021-01-27T09:30:17.038840+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 22 tests from LibRadosMisc api_snapshots_pp: Running main() from gmock_main.cc 2021-01-27T09:30:19.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [==========] Running 18 tests from 4 test suites. 2021-01-27T09:30:19.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2021-01-27T09:30:19.045 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2021-01-27T09:30:19.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: seed 32406 2021-01-27T09:30:19.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2021-01-27T09:30:19.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (4508 ms) 2021-01-27T09:30:19.046 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2021-01-27T09:30:19.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (3261 ms) 2021-01-27T09:30:19.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2021-01-27T09:30:19.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2901 ms) 2021-01-27T09:30:19.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2021-01-27T09:30:19.047 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2507 ms) 2021-01-27T09:30:19.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2021-01-27T09:30:19.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4996 ms) 2021-01-27T09:30:19.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (18173 ms total) 2021-01-27T09:30:19.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: 2021-01-27T09:30:19.048 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2021-01-27T09:30:19.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2021-01-27T09:30:19.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (3584 ms) 2021-01-27T09:30:19.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2021-01-27T09:30:19.049 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4655 ms) 2021-01-27T09:30:19.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2021-01-27T09:30:19.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6000 ms) 2021-01-27T09:30:19.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2021-01-27T09:30:19.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4020 ms) 2021-01-27T09:30:19.050 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2021-01-27T09:30:19.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (1988 ms) 2021-01-27T09:30:19.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2021-01-27T09:30:19.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: deleting snap 23 in pool test-rados-api-smithi103-32406-7 2021-01-27T09:30:19.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: waiting for snaps to purge 2021-01-27T09:30:19.051 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (18422 ms) 2021-01-27T09:30:19.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (38669 ms total) 2021-01-27T09:30:19.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: 2021-01-27T09:30:19.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2021-01-27T09:30:19.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2021-01-27T09:30:19.052 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3035 ms) 2021-01-27T09:30:19.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2021-01-27T09:30:19.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1997 ms) 2021-01-27T09:30:19.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2021-01-27T09:30:19.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2014 ms) 2021-01-27T09:30:19.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2021-01-27T09:30:19.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2337 ms) 2021-01-27T09:30:19.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9383 ms total) 2021-01-27T09:30:19.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: 2021-01-27T09:30:19.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2021-01-27T09:30:19.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2021-01-27T09:30:19.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4052 ms) 2021-01-27T09:30:19.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2021-01-27T09:30:19.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4005 ms) 2021-01-27T09:30:19.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2021-01-27T09:30:19.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4332 ms) 2021-01-27T09:30:19.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12389 ms total) 2021-01-27T09:30:19.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: 2021-01-27T09:30:19.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2021-01-27T09:30:19.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [==========] 18 tests from 4 test suites ran. (105987 ms total) 2021-01-27T09:30:19.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2021-01-27T09:30:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: cluster 2021-01-27T09:30:18.021096+0000 mon.a (mon.0) 1295 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.031045+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:30:19.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.031457+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: cluster 2021-01-27T09:30:18.031920+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T09:30:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.033202+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.040236+0000 mon.b (mon.2) 97 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.041121+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:18.049898+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.039733+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.039993+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: cluster 2021-01-27T09:30:19.040361+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T09:30:19.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.042234+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.103:0/553709045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.044464+0000 mon.b (mon.2) 98 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.045014+0000 mon.b (mon.2) 99 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.045918+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.048608+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:19 smithi047 bash[9721]: audit 2021-01-27T09:30:19.049045+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:19.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: cluster 2021-01-27T09:30:18.021096+0000 mon.a (mon.0) 1295 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:19.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.031045+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:30:19.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.031457+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: cluster 2021-01-27T09:30:18.031920+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T09:30:19.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.033202+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.040236+0000 mon.b (mon.2) 97 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.041121+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:18.049898+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.039733+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.039993+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:19.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: cluster 2021-01-27T09:30:19.040361+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T09:30:19.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.042234+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.103:0/553709045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.044464+0000 mon.b (mon.2) 98 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.045014+0000 mon.b (mon.2) 99 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:19.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.045918+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.048608+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[13570]: audit 2021-01-27T09:30:19.049045+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:19.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: cluster 2021-01-27T09:30:18.021096+0000 mon.a (mon.0) 1295 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:19.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.031045+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-13"}]': finished 2021-01-27T09:30:19.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.031457+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: cluster 2021-01-27T09:30:18.031920+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T09:30:19.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.033202+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.103:0/904686425' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.040236+0000 mon.b (mon.2) 97 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.041121+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]: dispatch 2021-01-27T09:30:19.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:18.049898+0000 mon.a (mon.0) 1300 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.039733+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32406-19"}]': finished 2021-01-27T09:30:19.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.039993+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:19.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: cluster 2021-01-27T09:30:19.040361+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T09:30:19.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.042234+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.103:0/553709045' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.044464+0000 mon.b (mon.2) 98 : audit [INF] from='client.? 172.21.15.103:0/2201900639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.045014+0000 mon.b (mon.2) 99 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:19.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.045918+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:19.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.048608+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]: dispatch 2021-01-27T09:30:19.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:19 smithi103 bash[9772]: audit 2021-01-27T09:30:19.049045+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: Running main() from gmock_main.cc 2021-01-27T09:30:20.053 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [==========] Running 40 tests from 2 test suites. 2021-01-27T09:30:20.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] Global test environment set-up. 2021-01-27T09:30:20.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] 24 tests from LibRadosAio 2021-01-27T09:30:20.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2021-01-27T09:30:20.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.TooBig (10819 ms) 2021-01-27T09:30:20.054 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2021-01-27T09:30:20.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (8635 ms) 2021-01-27T09:30:20.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2021-01-27T09:30:20.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3561 ms) 2021-01-27T09:30:20.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2021-01-27T09:30:20.055 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3033 ms) 2021-01-27T09:30:20.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2021-01-27T09:30:20.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (6302 ms) 2021-01-27T09:30:20.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2021-01-27T09:30:20.056 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3505 ms) 2021-01-27T09:30:20.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2021-01-27T09:30:20.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (4057 ms) 2021-01-27T09:30:20.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2021-01-27T09:30:20.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3650 ms) 2021-01-27T09:30:20.057 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2021-01-27T09:30:20.058 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3027 ms) 2021-01-27T09:30:20.058 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2021-01-27T09:30:20.058 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2988 ms) 2021-01-27T09:30:20.058 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2021-01-27T09:30:20.058 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2993 ms) 2021-01-27T09:30:20.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2021-01-27T09:30:20.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3442 ms) 2021-01-27T09:30:20.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2021-01-27T09:30:20.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2581 ms) 2021-01-27T09:30:20.059 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2021-01-27T09:30:20.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3024 ms) 2021-01-27T09:30:20.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2021-01-27T09:30:20.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.Flush (2964 ms) 2021-01-27T09:30:20.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2021-01-27T09:30:20.060 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3014 ms) 2021-01-27T09:30:20.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2021-01-27T09:30:20.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3472 ms) 2021-01-27T09:30:20.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2021-01-27T09:30:20.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3357 ms) 2021-01-27T09:30:20.061 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2021-01-27T09:30:20.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (2917 ms) 2021-01-27T09:30:20.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2021-01-27T09:30:20.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3027 ms) 2021-01-27T09:30:20.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2021-01-27T09:30:20.062 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3432 ms) 2021-01-27T09:30:20.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2021-01-27T09:30:20.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (2930 ms) 2021-01-27T09:30:20.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2021-01-27T09:30:20.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3467 ms) 2021-01-27T09:30:20.063 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2021-01-27T09:30:20.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2890 ms) 2021-01-27T09:30:20.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] 24 tests from LibRadosAio (93087 ms total) 2021-01-27T09:30:20.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: 2021-01-27T09:30:20.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2021-01-27T09:30:20.064 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2021-01-27T09:30:20.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7054 ms) 2021-01-27T09:30:20.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2021-01-27T09:30:20.065 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6956 ms) 2021-01-27T09:30:20.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: cluster 2021-01-27T09:30:18.395513+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v484: 236 pgs: 6 unknown, 230 active+clean; 27 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 12 op/s 2021-01-27T09:30:20.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: cluster 2021-01-27T09:30:19.463321+0000 mon.a (mon.0) 1307 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:20.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.044330+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:20.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.045502+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:20.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.045674+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:20.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: cluster 2021-01-27T09:30:20.046135+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T09:30:20.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.051464+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.052594+0000 mon.b (mon.2) 101 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.053345+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.054040+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.086154+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.087199+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:20 smithi047 bash[9721]: audit 2021-01-27T09:30:20.087677+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:20.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: cluster 2021-01-27T09:30:18.395513+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v484: 236 pgs: 6 unknown, 230 active+clean; 27 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 12 op/s 2021-01-27T09:30:20.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: cluster 2021-01-27T09:30:19.463321+0000 mon.a (mon.0) 1307 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.044330+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.045502+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.045674+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: cluster 2021-01-27T09:30:20.046135+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T09:30:20.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.051464+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.052594+0000 mon.b (mon.2) 101 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.053345+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.054040+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.086154+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.087199+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[9772]: audit 2021-01-27T09:30:20.087677+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:20.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: cluster 2021-01-27T09:30:18.395513+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v484: 236 pgs: 6 unknown, 230 active+clean; 27 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 12 op/s 2021-01-27T09:30:20.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: cluster 2021-01-27T09:30:19.463321+0000 mon.a (mon.0) 1307 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:20.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.044330+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:20.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.045502+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-26"}]': finished 2021-01-27T09:30:20.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.045674+0000 mon.a (mon.0) 1310 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:20.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: cluster 2021-01-27T09:30:20.046135+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T09:30:20.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.051464+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.103:0/1946715429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.052594+0000 mon.b (mon.2) 101 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.053345+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]: dispatch 2021-01-27T09:30:20.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.054040+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:20.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.086154+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.087199+0000 mon.a (mon.0) 1315 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:20.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:20 smithi103 bash[13570]: audit 2021-01-27T09:30:20.087677+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:21.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.RoPP (69546 ms total) 2021-01-27T09:30:21.031 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.032 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2021-01-27T09:30:21.032 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2021-01-27T09:30:21.033 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (167 ms) 2021-01-27T09:30:21.033 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (167 ms total) 2021-01-27T09:30:21.033 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.034 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2021-01-27T09:30:21.034 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2021-01-27T09:30:21.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (39 ms) 2021-01-27T09:30:21.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2021-01-27T09:30:21.035 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (4 ms) 2021-01-27T09:30:21.036 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (43 ms total) 2021-01-27T09:30:21.036 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.037 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2021-01-27T09:30:21.037 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2021-01-27T09:30:21.037 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (47 ms) 2021-01-27T09:30:21.038 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2021-01-27T09:30:21.038 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (4 ms) 2021-01-27T09:30:21.039 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (51 ms total) 2021-01-27T09:30:21.039 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.039 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2021-01-27T09:30:21.040 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2021-01-27T09:30:21.040 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (47 ms) 2021-01-27T09:30:21.041 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2021-01-27T09:30:21.041 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (7 ms) 2021-01-27T09:30:21.041 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (55 ms total) 2021-01-27T09:30:21.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2021-01-27T09:30:21.042 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2021-01-27T09:30:21.043 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1038 ms) 2021-01-27T09:30:21.043 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1038 ms total) 2021-01-27T09:30:21.043 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: 2021-01-27T09:30:21.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [----------] Global test environment tear-down 2021-01-27T09:30:21.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (108002 ms total) 2021-01-27T09:30:21.044 INFO:tasks.workunit.client.0.smithi103.stdout: api_misc_pp: [ PASSED ] 31 tests. 2021-01-27T09:30:22.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: cluster 2021-01-27T09:30:20.396423+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v487: 260 pgs: 15 creating+peering, 49 unknown, 196 active+clean; 26 KiB data, 286 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:22.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: audit 2021-01-27T09:30:21.023245+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:22.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: audit 2021-01-27T09:30:21.023477+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:22.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: audit 2021-01-27T09:30:21.024014+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:22.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: cluster 2021-01-27T09:30:21.024124+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T09:30:22.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:22 smithi047 bash[9721]: audit 2021-01-27T09:30:21.044129+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:22.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: cluster 2021-01-27T09:30:20.396423+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v487: 260 pgs: 15 creating+peering, 49 unknown, 196 active+clean; 26 KiB data, 286 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:22.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: audit 2021-01-27T09:30:21.023245+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:22.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: audit 2021-01-27T09:30:21.023477+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:22.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: audit 2021-01-27T09:30:21.024014+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:22.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: cluster 2021-01-27T09:30:21.024124+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T09:30:22.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[13570]: audit 2021-01-27T09:30:21.044129+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:22.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: cluster 2021-01-27T09:30:20.396423+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v487: 260 pgs: 15 creating+peering, 49 unknown, 196 active+clean; 26 KiB data, 286 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:22.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: audit 2021-01-27T09:30:21.023245+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32296-36"}]': finished 2021-01-27T09:30:22.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: audit 2021-01-27T09:30:21.023477+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:22.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: audit 2021-01-27T09:30:21.024014+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:22.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: cluster 2021-01-27T09:30:21.024124+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T09:30:22.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:22 smithi103 bash[9772]: audit 2021-01-27T09:30:21.044129+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:23.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:23 smithi047 bash[9721]: cluster 2021-01-27T09:30:22.452710+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T09:30:23.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:23 smithi047 bash[9721]: audit 2021-01-27T09:30:22.455383+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:23.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:23 smithi047 bash[9721]: audit 2021-01-27T09:30:22.462219+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:23.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:23 smithi047 bash[9721]: audit 2021-01-27T09:30:22.463274+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:23.393 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[9772]: cluster 2021-01-27T09:30:22.452710+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T09:30:23.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[9772]: audit 2021-01-27T09:30:22.455383+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:23.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[9772]: audit 2021-01-27T09:30:22.462219+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:23.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[9772]: audit 2021-01-27T09:30:22.463274+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[13570]: cluster 2021-01-27T09:30:22.452710+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T09:30:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[13570]: audit 2021-01-27T09:30:22.455383+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[13570]: audit 2021-01-27T09:30:22.462219+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:23 smithi103 bash[13570]: audit 2021-01-27T09:30:22.463274+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:24.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[10018]: debug 2021-01-27T09:30:24.178+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:24.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: cluster 2021-01-27T09:30:22.397244+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v490: 260 pgs: 60 unknown, 200 active+clean; 26 KiB data, 287 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:24.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: audit 2021-01-27T09:30:23.063070+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:24.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: audit 2021-01-27T09:30:23.063649+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:24.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: audit 2021-01-27T09:30:23.064019+0000 mon.a (mon.0) 1327 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:24.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: cluster 2021-01-27T09:30:23.064189+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T09:30:24.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: audit 2021-01-27T09:30:23.064569+0000 mon.b (mon.2) 103 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:24.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[13570]: audit 2021-01-27T09:30:23.068896+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:24.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: cluster 2021-01-27T09:30:22.397244+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v490: 260 pgs: 60 unknown, 200 active+clean; 26 KiB data, 287 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:24.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: audit 2021-01-27T09:30:23.063070+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:24.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: audit 2021-01-27T09:30:23.063649+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:24.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: audit 2021-01-27T09:30:23.064019+0000 mon.a (mon.0) 1327 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:24.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: cluster 2021-01-27T09:30:23.064189+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T09:30:24.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: audit 2021-01-27T09:30:23.064569+0000 mon.b (mon.2) 103 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:24.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:24 smithi103 bash[9772]: audit 2021-01-27T09:30:23.068896+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:24.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: cluster 2021-01-27T09:30:22.397244+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v490: 260 pgs: 60 unknown, 200 active+clean; 26 KiB data, 287 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: audit 2021-01-27T09:30:23.063070+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: audit 2021-01-27T09:30:23.063649+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.103:0/4262908142' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: audit 2021-01-27T09:30:23.064019+0000 mon.a (mon.0) 1327 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: cluster 2021-01-27T09:30:23.064189+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T09:30:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: audit 2021-01-27T09:30:23.064569+0000 mon.b (mon.2) 103 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:24 smithi047 bash[9721]: audit 2021-01-27T09:30:23.068896+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:25.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[13570]: audit 2021-01-27T09:30:24.075147+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:25.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[13570]: cluster 2021-01-27T09:30:24.075435+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T09:30:25.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[13570]: audit 2021-01-27T09:30:24.077110+0000 mon.b (mon.2) 104 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[13570]: audit 2021-01-27T09:30:24.078367+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[13570]: audit 2021-01-27T09:30:24.183425+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:25.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[9772]: audit 2021-01-27T09:30:24.075147+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:25.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[9772]: cluster 2021-01-27T09:30:24.075435+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T09:30:25.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[9772]: audit 2021-01-27T09:30:24.077110+0000 mon.b (mon.2) 104 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[9772]: audit 2021-01-27T09:30:24.078367+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:25 smithi103 bash[9772]: audit 2021-01-27T09:30:24.183425+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:25.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:25 smithi047 bash[9721]: audit 2021-01-27T09:30:24.075147+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:25.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:25 smithi047 bash[9721]: cluster 2021-01-27T09:30:24.075435+0000 mon.a (mon.0) 1331 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T09:30:25.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:25 smithi047 bash[9721]: audit 2021-01-27T09:30:24.077110+0000 mon.b (mon.2) 104 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:25 smithi047 bash[9721]: audit 2021-01-27T09:30:24.078367+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]: dispatch 2021-01-27T09:30:25.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:25 smithi047 bash[9721]: audit 2021-01-27T09:30:24.183425+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:26.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: cluster 2021-01-27T09:30:24.397987+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v493: 236 pgs: 3 creating+peering, 18 unknown, 215 active+clean; 26 KiB data, 292 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:26.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: cluster 2021-01-27T09:30:25.072688+0000 mon.a (mon.0) 1333 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:26.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:25.091155+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]': finished 2021-01-27T09:30:26.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: cluster 2021-01-27T09:30:25.091347+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T09:30:26.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:25.100601+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:26.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:25.102957+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.103:0/3565605503' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:25.103791+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:26.021795+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:26.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:26.022274+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:26.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: cluster 2021-01-27T09:30:26.022835+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T09:30:26.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[9772]: audit 2021-01-27T09:30:26.026882+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:26.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: cluster 2021-01-27T09:30:24.397987+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v493: 236 pgs: 3 creating+peering, 18 unknown, 215 active+clean; 26 KiB data, 292 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:26.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: cluster 2021-01-27T09:30:25.072688+0000 mon.a (mon.0) 1333 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:26.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:25.091155+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]': finished 2021-01-27T09:30:26.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: cluster 2021-01-27T09:30:25.091347+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T09:30:26.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:25.100601+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:26.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:25.102957+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.103:0/3565605503' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:25.103791+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:26.021795+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:26.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:26.022274+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:26.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: cluster 2021-01-27T09:30:26.022835+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T09:30:26.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:26 smithi103 bash[13570]: audit 2021-01-27T09:30:26.026882+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:26.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: cluster 2021-01-27T09:30:24.397987+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v493: 236 pgs: 3 creating+peering, 18 unknown, 215 active+clean; 26 KiB data, 292 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:26.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: cluster 2021-01-27T09:30:25.072688+0000 mon.a (mon.0) 1333 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:26.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:25.091155+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-15", "mode": "writeback"}]': finished 2021-01-27T09:30:26.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: cluster 2021-01-27T09:30:25.091347+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T09:30:26.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:25.100601+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:26.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:25.102957+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.103:0/3565605503' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:25.103791+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:26.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:26.021795+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:26.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:26.022274+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:26.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: cluster 2021-01-27T09:30:26.022835+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T09:30:26.557 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:26 smithi047 bash[9721]: audit 2021-01-27T09:30:26.026882+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]: dispatch 2021-01-27T09:30:27.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:26.082829+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:26.089693+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.024489+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.024710+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: cluster 2021-01-27T09:30:27.024893+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T09:30:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.030164+0000 mon.b (mon.2) 106 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.031374+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.046535+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.047162+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.048831+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:27 smithi047 bash[9721]: audit 2021-01-27T09:30:27.049220+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:26.082829+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:26.089693+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.024489+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.024710+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: cluster 2021-01-27T09:30:27.024893+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T09:30:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.030164+0000 mon.b (mon.2) 106 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.031374+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.046535+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.047162+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.048831+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[9772]: audit 2021-01-27T09:30:27.049220+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:26.082829+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:26.089693+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:27.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.024489+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? 172.21.15.103:0/3978908890' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-27"}]': finished 2021-01-27T09:30:27.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.024710+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:27.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: cluster 2021-01-27T09:30:27.024893+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T09:30:27.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.030164+0000 mon.b (mon.2) 106 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.031374+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]: dispatch 2021-01-27T09:30:27.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.046535+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.047162+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.048831+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:27.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:27 smithi103 bash[13570]: audit 2021-01-27T09:30:27.049220+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: cluster 2021-01-27T09:30:26.398829+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v496: 260 pgs: 32 unknown, 228 active+clean; 26 KiB data, 294 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:27.049985+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:27.483057+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: cluster 2021-01-27T09:30:28.020155+0000 mon.a (mon.0) 1350 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:28.037867+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:28.038310+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: cluster 2021-01-27T09:30:28.038631+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T09:30:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:28.039684+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:28.041789+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:28 smithi047 bash[9721]: audit 2021-01-27T09:30:28.042496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:28.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: cluster 2021-01-27T09:30:26.398829+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v496: 260 pgs: 32 unknown, 228 active+clean; 26 KiB data, 294 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:28.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:27.049985+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:27.483057+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: cluster 2021-01-27T09:30:28.020155+0000 mon.a (mon.0) 1350 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:28.037867+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:28.038310+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: cluster 2021-01-27T09:30:28.038631+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T09:30:28.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:28.039684+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:28.041789+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[13570]: audit 2021-01-27T09:30:28.042496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:28.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: cluster 2021-01-27T09:30:26.398829+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v496: 260 pgs: 32 unknown, 228 active+clean; 26 KiB data, 294 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:28.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:27.049985+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:27.483057+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:28.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: cluster 2021-01-27T09:30:28.020155+0000 mon.a (mon.0) 1350 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:28.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:28.037867+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-15"}]': finished 2021-01-27T09:30:28.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:28.038310+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:28.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: cluster 2021-01-27T09:30:28.038631+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T09:30:28.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:28.039684+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:28.041789+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:28.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:28 smithi103 bash[9772]: audit 2021-01-27T09:30:28.042496+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:30.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:30 smithi047 bash[9721]: cluster 2021-01-27T09:30:28.400239+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v499: 260 pgs: 10 creating+peering, 22 unknown, 228 active+clean; 26 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:30.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:30 smithi047 bash[9721]: audit 2021-01-27T09:30:29.465121+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:30.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:30 smithi047 bash[9721]: cluster 2021-01-27T09:30:29.465909+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T09:30:30.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[13570]: cluster 2021-01-27T09:30:28.400239+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v499: 260 pgs: 10 creating+peering, 22 unknown, 228 active+clean; 26 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[13570]: audit 2021-01-27T09:30:29.465121+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[13570]: cluster 2021-01-27T09:30:29.465909+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T09:30:30.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[9772]: cluster 2021-01-27T09:30:28.400239+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v499: 260 pgs: 10 creating+peering, 22 unknown, 228 active+clean; 26 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:30.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[9772]: audit 2021-01-27T09:30:29.465121+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? 172.21.15.103:0/571065164' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:30.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:30 smithi103 bash[9772]: cluster 2021-01-27T09:30:29.465909+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T09:30:31.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:31 smithi047 bash[9721]: audit 2021-01-27T09:30:30.042517+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:31 smithi047 bash[9721]: cluster 2021-01-27T09:30:30.042648+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T09:30:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:31 smithi047 bash[9721]: audit 2021-01-27T09:30:30.054053+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:31.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:31 smithi047 bash[9721]: audit 2021-01-27T09:30:30.060070+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[9772]: audit 2021-01-27T09:30:30.042517+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:31.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[9772]: cluster 2021-01-27T09:30:30.042648+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T09:30:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[9772]: audit 2021-01-27T09:30:30.054053+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[9772]: audit 2021-01-27T09:30:30.060070+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:31.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[13570]: audit 2021-01-27T09:30:30.042517+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:31.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[13570]: cluster 2021-01-27T09:30:30.042648+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T09:30:31.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[13570]: audit 2021-01-27T09:30:30.054053+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:31.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:31 smithi103 bash[13570]: audit 2021-01-27T09:30:30.060070+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: cluster 2021-01-27T09:30:30.401039+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v502: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:32.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: audit 2021-01-27T09:30:31.057279+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:32.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: cluster 2021-01-27T09:30:31.057671+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T09:30:32.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: audit 2021-01-27T09:30:31.060252+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.103:0/1191770848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: audit 2021-01-27T09:30:31.061125+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: audit 2021-01-27T09:30:31.080301+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:32.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[9772]: audit 2021-01-27T09:30:31.081453+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:32.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: cluster 2021-01-27T09:30:30.401039+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v502: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:32.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: audit 2021-01-27T09:30:31.057279+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:32.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: cluster 2021-01-27T09:30:31.057671+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T09:30:32.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: audit 2021-01-27T09:30:31.060252+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.103:0/1191770848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: audit 2021-01-27T09:30:31.061125+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: audit 2021-01-27T09:30:31.080301+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:32.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:32 smithi103 bash[13570]: audit 2021-01-27T09:30:31.081453+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:32.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: cluster 2021-01-27T09:30:30.401039+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v502: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:32.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: audit 2021-01-27T09:30:31.057279+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:32.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: cluster 2021-01-27T09:30:31.057671+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T09:30:32.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: audit 2021-01-27T09:30:31.060252+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.103:0/1191770848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: audit 2021-01-27T09:30:31.061125+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:32.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: audit 2021-01-27T09:30:31.080301+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:32.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:32 smithi047 bash[9721]: audit 2021-01-27T09:30:31.081453+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:33.083 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: Running main() from gmock_main.cc 2021-01-27T09:30:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [==========] Running 53 tests from 4 test suites. 2021-01-27T09:30:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [----------] Global test environment set-up. 2021-01-27T09:30:33.084 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [----------] 28 tests from LibRadosAio 2021-01-27T09:30:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2021-01-27T09:30:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (11896 ms) 2021-01-27T09:30:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2021-01-27T09:30:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (27345 ms) 2021-01-27T09:30:33.085 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2021-01-27T09:30:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (7340 ms) 2021-01-27T09:30:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2021-01-27T09:30:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (2989 ms) 2021-01-27T09:30:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2021-01-27T09:30:33.086 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2994 ms) 2021-01-27T09:30:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2021-01-27T09:30:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3443 ms) 2021-01-27T09:30:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2021-01-27T09:30:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2579 ms) 2021-01-27T09:30:33.087 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2021-01-27T09:30:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3018 ms) 2021-01-27T09:30:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2021-01-27T09:30:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2975 ms) 2021-01-27T09:30:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2021-01-27T09:30:33.088 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3013 ms) 2021-01-27T09:30:33.089 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2021-01-27T09:30:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3469 ms) 2021-01-27T09:30:33.091 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2021-01-27T09:30:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3356 ms) 2021-01-27T09:30:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2021-01-27T09:30:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2920 ms) 2021-01-27T09:30:33.092 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2021-01-27T09:30:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3018 ms) 2021-01-27T09:30:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2021-01-27T09:30:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3436 ms) 2021-01-27T09:30:33.093 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2021-01-27T09:30:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2940 ms) 2021-01-27T09:30:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2021-01-27T09:30:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3459 ms) 2021-01-27T09:30:33.094 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2021-01-27T09:30:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2890 ms) 2021-01-27T09:30:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2021-01-27T09:30:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3037 ms) 2021-01-27T09:30:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2021-01-27T09:30:33.095 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3011 ms) 2021-01-27T09:30:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2021-01-27T09:30:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3455 ms) 2021-01-27T09:30:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2021-01-27T09:30:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2497 ms) 2021-01-27T09:30:33.096 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2021-01-27T09:30:33.097 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2984 ms) 2021-01-27T09:30:33.097 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2021-01-27T09:30:33.097 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3050 ms) 2021-01-27T09:30:33.097 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2021-01-27T09:30:33.097 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (2952 ms) 2021-01-27T09:30:33.098 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2021-01-27T09:30:33.098 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3017 ms) 2021-01-27T09:30:33.098 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2021-01-27T09:30:33.393 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.059639+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:33.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.060035+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:33.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: cluster 2021-01-27T09:30:32.060211+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T09:30:33.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.062154+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:33.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.074550+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.075509+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[13570]: audit 2021-01-27T09:30:32.076420+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:33.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.059639+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.060035+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: cluster 2021-01-27T09:30:32.060211+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T09:30:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.062154+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.074550+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.075509+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:33 smithi103 bash[9772]: audit 2021-01-27T09:30:32.076420+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:33.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.059639+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:33.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.060035+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:33.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: cluster 2021-01-27T09:30:32.060211+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T09:30:33.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.062154+0000 mon.b (mon.2) 109 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:33.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.074550+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.075509+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:33.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:33 smithi047 bash[9721]: audit 2021-01-27T09:30:32.076420+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:34.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[10018]: debug 2021-01-27T09:30:34.190+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:34.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: cluster 2021-01-27T09:30:32.401948+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v505: 260 pgs: 6 creating+peering, 57 unknown, 197 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:34.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.080709+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.080917+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: cluster 2021-01-27T09:30:33.081124+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T09:30:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.082839+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.083737+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.083927+0000 mon.b (mon.2) 110 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:34.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[13570]: audit 2021-01-27T09:30:33.085494+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: cluster 2021-01-27T09:30:32.401948+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v505: 260 pgs: 6 creating+peering, 57 unknown, 197 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.080709+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:34.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.080917+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: cluster 2021-01-27T09:30:33.081124+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T09:30:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.082839+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.083737+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.083927+0000 mon.b (mon.2) 110 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:34.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:34 smithi103 bash[9772]: audit 2021-01-27T09:30:33.085494+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:34.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:34.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: cluster 2021-01-27T09:30:32.401948+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v505: 260 pgs: 6 creating+peering, 57 unknown, 197 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:30:34.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.080709+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:34.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.080917+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:34.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: cluster 2021-01-27T09:30:33.081124+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T09:30:34.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.082839+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.103:0/2561629668' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.083737+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]: dispatch 2021-01-27T09:30:34.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.083927+0000 mon.b (mon.2) 110 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:34.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:34 smithi047 bash[9721]: audit 2021-01-27T09:30:33.085494+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]: dispatch 2021-01-27T09:30:35.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: cluster 2021-01-27T09:30:34.079413+0000 mon.a (mon.0) 1375 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:35.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.094171+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:35.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.094287+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]': finished 2021-01-27T09:30:35.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: cluster 2021-01-27T09:30:34.094399+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T09:30:35.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.096397+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.103:0/2366934222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.096979+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.127037+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.127444+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.128217+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.128527+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.129068+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.129357+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.192480+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:35.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.234952+0000 mon.b (mon.2) 111 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:35.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[13570]: audit 2021-01-27T09:30:34.236431+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:35.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: cluster 2021-01-27T09:30:34.079413+0000 mon.a (mon.0) 1375 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:35.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.094171+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:35.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.094287+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]': finished 2021-01-27T09:30:35.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: cluster 2021-01-27T09:30:34.094399+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T09:30:35.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.096397+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.103:0/2366934222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.096979+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.127037+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.127444+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.128217+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.128527+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.129068+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.129357+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.192480+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:35.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.234952+0000 mon.b (mon.2) 111 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:35.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:35 smithi103 bash[9772]: audit 2021-01-27T09:30:34.236431+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: cluster 2021-01-27T09:30:34.079413+0000 mon.a (mon.0) 1375 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.094171+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-28"}]': finished 2021-01-27T09:30:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.094287+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-17", "mode": "writeback"}]': finished 2021-01-27T09:30:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: cluster 2021-01-27T09:30:34.094399+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T09:30:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.096397+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.103:0/2366934222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.096979+0000 mon.a (mon.0) 1379 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.127037+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.127444+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.128217+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.128527+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:35.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.129068+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.129357+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:35.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.192480+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:35.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.234952+0000 mon.b (mon.2) 111 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:35.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:35 smithi047 bash[9721]: audit 2021-01-27T09:30:34.236431+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:36.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: cluster 2021-01-27T09:30:34.402851+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v508: 260 pgs: 43 unknown, 217 active+clean; 26 KiB data, 302 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:36.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.098580+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:36.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.098901+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:36.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.099016+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:36.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: cluster 2021-01-27T09:30:35.099095+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T09:30:36.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.100808+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.103396+0000 mon.b (mon.2) 112 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.113621+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: audit 2021-01-27T09:30:35.114398+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:36 smithi047 bash[9721]: cluster 2021-01-27T09:30:36.018689+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:36.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: cluster 2021-01-27T09:30:34.402851+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v508: 260 pgs: 43 unknown, 217 active+clean; 26 KiB data, 302 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.098580+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.098901+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:36.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.099016+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: cluster 2021-01-27T09:30:35.099095+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T09:30:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.100808+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.103396+0000 mon.b (mon.2) 112 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.113621+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: audit 2021-01-27T09:30:35.114398+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[13570]: cluster 2021-01-27T09:30:36.018689+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: cluster 2021-01-27T09:30:34.402851+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v508: 260 pgs: 43 unknown, 217 active+clean; 26 KiB data, 302 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:30:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.098580+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:36.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.098901+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.099016+0000 mon.a (mon.0) 1386 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: cluster 2021-01-27T09:30:35.099095+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T09:30:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.100808+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.103396+0000 mon.b (mon.2) 112 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.113621+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:36.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: audit 2021-01-27T09:30:35.114398+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]: dispatch 2021-01-27T09:30:36.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:36 smithi103 bash[9772]: cluster 2021-01-27T09:30:36.018689+0000 mon.a (mon.0) 1390 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:37.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:37 smithi047 bash[9721]: audit 2021-01-27T09:30:36.448637+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:37 smithi047 bash[9721]: cluster 2021-01-27T09:30:36.448905+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T09:30:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:37 smithi047 bash[9721]: audit 2021-01-27T09:30:37.035628+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:37 smithi047 bash[9721]: cluster 2021-01-27T09:30:37.035776+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T09:30:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:37 smithi047 bash[9721]: audit 2021-01-27T09:30:37.037315+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:37.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[9772]: audit 2021-01-27T09:30:36.448637+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:37.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[9772]: cluster 2021-01-27T09:30:36.448905+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T09:30:37.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[9772]: audit 2021-01-27T09:30:37.035628+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:37.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[9772]: cluster 2021-01-27T09:30:37.035776+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T09:30:37.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[9772]: audit 2021-01-27T09:30:37.037315+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[13570]: audit 2021-01-27T09:30:36.448637+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-17"}]': finished 2021-01-27T09:30:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[13570]: cluster 2021-01-27T09:30:36.448905+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T09:30:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[13570]: audit 2021-01-27T09:30:37.035628+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[13570]: cluster 2021-01-27T09:30:37.035776+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T09:30:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:37 smithi103 bash[13570]: audit 2021-01-27T09:30:37.037315+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:38 smithi047 bash[9721]: cluster 2021-01-27T09:30:36.403885+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v511: 228 pgs: 228 active+clean; 26 KiB data, 303 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-01-27T09:30:38.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:38 smithi047 bash[9721]: audit 2021-01-27T09:30:38.043289+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:38.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:38 smithi047 bash[9721]: cluster 2021-01-27T09:30:38.044273+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T09:30:38.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:38 smithi047 bash[9721]: audit 2021-01-27T09:30:38.052233+0000 mon.b (mon.2) 113 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:38 smithi047 bash[9721]: audit 2021-01-27T09:30:38.055408+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[9772]: cluster 2021-01-27T09:30:36.403885+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v511: 228 pgs: 228 active+clean; 26 KiB data, 303 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-01-27T09:30:38.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[9772]: audit 2021-01-27T09:30:38.043289+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[9772]: cluster 2021-01-27T09:30:38.044273+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T09:30:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[9772]: audit 2021-01-27T09:30:38.052233+0000 mon.b (mon.2) 113 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[9772]: audit 2021-01-27T09:30:38.055408+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[13570]: cluster 2021-01-27T09:30:36.403885+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v511: 228 pgs: 228 active+clean; 26 KiB data, 303 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-01-27T09:30:38.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[13570]: audit 2021-01-27T09:30:38.043289+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.103:0/2002916170' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:38.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[13570]: cluster 2021-01-27T09:30:38.044273+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T09:30:38.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[13570]: audit 2021-01-27T09:30:38.052233+0000 mon.b (mon.2) 113 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:38.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:38 smithi103 bash[13570]: audit 2021-01-27T09:30:38.055408+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:39.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: cluster 2021-01-27T09:30:39.036157+0000 mon.a (mon.0) 1399 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:39.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: audit 2021-01-27T09:30:39.051729+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:39.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: cluster 2021-01-27T09:30:39.052032+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T09:30:39.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: audit 2021-01-27T09:30:39.055076+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: audit 2021-01-27T09:30:39.069837+0000 mon.b (mon.2) 114 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:39.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: audit 2021-01-27T09:30:39.074644+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:39 smithi047 bash[9721]: audit 2021-01-27T09:30:39.075021+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:39.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: cluster 2021-01-27T09:30:39.036157+0000 mon.a (mon.0) 1399 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:39.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: audit 2021-01-27T09:30:39.051729+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: cluster 2021-01-27T09:30:39.052032+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T09:30:39.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: audit 2021-01-27T09:30:39.055076+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: audit 2021-01-27T09:30:39.069837+0000 mon.b (mon.2) 114 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: audit 2021-01-27T09:30:39.074644+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[9772]: audit 2021-01-27T09:30:39.075021+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:39.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: cluster 2021-01-27T09:30:39.036157+0000 mon.a (mon.0) 1399 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:39.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: audit 2021-01-27T09:30:39.051729+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:39.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: cluster 2021-01-27T09:30:39.052032+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T09:30:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: audit 2021-01-27T09:30:39.055076+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: audit 2021-01-27T09:30:39.069837+0000 mon.b (mon.2) 114 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:39.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: audit 2021-01-27T09:30:39.074644+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:39.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:39 smithi103 bash[13570]: audit 2021-01-27T09:30:39.075021+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:40.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: cluster 2021-01-27T09:30:38.405344+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v514: 268 pgs: 19 creating+peering, 38 unknown, 211 active+clean; 38 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-01-27T09:30:40.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.057047+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:40.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.057276+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:40.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: cluster 2021-01-27T09:30:40.057547+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T09:30:40.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.058711+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.060267+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.060887+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.061433+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.103:0/3867932605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:40.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.064755+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:40 smithi047 bash[9721]: audit 2021-01-27T09:30:40.065464+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:40.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: cluster 2021-01-27T09:30:38.405344+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v514: 268 pgs: 19 creating+peering, 38 unknown, 211 active+clean; 38 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-01-27T09:30:40.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.057047+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:40.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.057276+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:40.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: cluster 2021-01-27T09:30:40.057547+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T09:30:40.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.058711+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.060267+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.060887+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.061433+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.103:0/3867932605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:40.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.064755+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[9772]: audit 2021-01-27T09:30:40.065464+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:40.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: cluster 2021-01-27T09:30:38.405344+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v514: 268 pgs: 19 creating+peering, 38 unknown, 211 active+clean; 38 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 2 op/s 2021-01-27T09:30:40.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.057047+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:40.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.057276+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:40.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: cluster 2021-01-27T09:30:40.057547+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T09:30:40.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.058711+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.060267+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:40.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.060887+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.103:0/3910125327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.061433+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.103:0/3867932605' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:40.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.064755+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]: dispatch 2021-01-27T09:30:40.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:40 smithi103 bash[13570]: audit 2021-01-27T09:30:40.065464+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:42.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: cluster 2021-01-27T09:30:40.406275+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v517: 260 pgs: 14 creating+peering, 38 unknown, 208 active+clean; 26 KiB data, 305 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:42.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.061509+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:42.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.061788+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:42.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.062163+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:42.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: cluster 2021-01-27T09:30:41.062700+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T09:30:42.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.063198+0000 mon.b (mon.2) 116 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.075806+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.104004+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.104561+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.105400+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.105684+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.106170+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:42.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[9772]: audit 2021-01-27T09:30:41.106542+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:42.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: cluster 2021-01-27T09:30:40.406275+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v517: 260 pgs: 14 creating+peering, 38 unknown, 208 active+clean; 26 KiB data, 305 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:42.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.061509+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:42.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.061788+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:42.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.062163+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:42.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: cluster 2021-01-27T09:30:41.062700+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T09:30:42.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.063198+0000 mon.b (mon.2) 116 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.075806+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.104004+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.104561+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.105400+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.105684+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.106170+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:42.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:42 smithi103 bash[13570]: audit 2021-01-27T09:30:41.106542+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: cluster 2021-01-27T09:30:40.406275+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v517: 260 pgs: 14 creating+peering, 38 unknown, 208 active+clean; 26 KiB data, 305 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.061509+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.061788+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-29"}]': finished 2021-01-27T09:30:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.062163+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: cluster 2021-01-27T09:30:41.062700+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T09:30:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.063198+0000 mon.b (mon.2) 116 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.075806+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]: dispatch 2021-01-27T09:30:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.104004+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.104561+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.105400+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.105684+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.106170+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:42 smithi047 bash[9721]: audit 2021-01-27T09:30:41.106542+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:43.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: cluster 2021-01-27T09:30:42.055763+0000 mon.a (mon.0) 1418 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.068607+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]': finished 2021-01-27T09:30:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.068828+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: cluster 2021-01-27T09:30:42.069033+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T09:30:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.070216+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.071158+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.071901+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.122939+0000 mon.b (mon.2) 117 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:43 smithi047 bash[9721]: audit 2021-01-27T09:30:42.124215+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:43.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: cluster 2021-01-27T09:30:42.055763+0000 mon.a (mon.0) 1418 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:43.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.068607+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]': finished 2021-01-27T09:30:43.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.068828+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:43.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: cluster 2021-01-27T09:30:42.069033+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T09:30:43.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.070216+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.071158+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.071901+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:43.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.122939+0000 mon.b (mon.2) 117 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:43.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[13570]: audit 2021-01-27T09:30:42.124215+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:43.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: cluster 2021-01-27T09:30:42.055763+0000 mon.a (mon.0) 1418 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:43.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.068607+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-19", "mode": "writeback"}]': finished 2021-01-27T09:30:43.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.068828+0000 mon.a (mon.0) 1420 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: cluster 2021-01-27T09:30:42.069033+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T09:30:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.070216+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.071158+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.071901+0000 mon.a (mon.0) 1423 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:43.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.122939+0000 mon.b (mon.2) 117 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:43.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:43 smithi103 bash[9772]: audit 2021-01-27T09:30:42.124215+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:44.518 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[10018]: debug 2021-01-27T09:30:44.201+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:44.519 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:44.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: cluster 2021-01-27T09:30:42.407186+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v520: 292 pgs: 14 creating+peering, 62 unknown, 216 active+clean; 26 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:30:44.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:43.488905+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:44.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:43.489612+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: cluster 2021-01-27T09:30:43.489841+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T09:30:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:43.490307+0000 mon.b (mon.2) 118 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:43.502584+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: cluster 2021-01-27T09:30:44.063745+0000 mon.a (mon.0) 1429 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:44.075844+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:44.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:44.076200+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:44.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: cluster 2021-01-27T09:30:44.076741+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T09:30:44.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:44.078813+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.103:0/3069002266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:44.083049+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:44 smithi047 bash[9721]: audit 2021-01-27T09:30:44.203844+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:44.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: cluster 2021-01-27T09:30:42.407186+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v520: 292 pgs: 14 creating+peering, 62 unknown, 216 active+clean; 26 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:30:44.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:43.488905+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:44.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:43.489612+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:44.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: cluster 2021-01-27T09:30:43.489841+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T09:30:44.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:43.490307+0000 mon.b (mon.2) 118 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:43.502584+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: cluster 2021-01-27T09:30:44.063745+0000 mon.a (mon.0) 1429 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:44.075844+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:44.076200+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: cluster 2021-01-27T09:30:44.076741+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T09:30:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:44.078813+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.103:0/3069002266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:44.083049+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[9772]: audit 2021-01-27T09:30:44.203844+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:44.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: cluster 2021-01-27T09:30:42.407186+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v520: 292 pgs: 14 creating+peering, 62 unknown, 216 active+clean; 26 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:30:44.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:43.488905+0000 mon.a (mon.0) 1425 : audit [INF] from='client.? 172.21.15.103:0/1551492980' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:44.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:43.489612+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:44.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: cluster 2021-01-27T09:30:43.489841+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T09:30:44.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:43.490307+0000 mon.b (mon.2) 118 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:43.502584+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]: dispatch 2021-01-27T09:30:44.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: cluster 2021-01-27T09:30:44.063745+0000 mon.a (mon.0) 1429 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:44.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:44.075844+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:44.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:44.076200+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-19"}]': finished 2021-01-27T09:30:44.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: cluster 2021-01-27T09:30:44.076741+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T09:30:44.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:44.078813+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.103:0/3069002266' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:44.083049+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:44.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:44 smithi103 bash[13570]: audit 2021-01-27T09:30:44.203844+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:46.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[9772]: cluster 2021-01-27T09:30:44.408135+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v523: 332 pgs: 6 creating+activating, 12 creating+peering, 66 unknown, 248 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:46.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[9772]: audit 2021-01-27T09:30:45.081216+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:46.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[9772]: cluster 2021-01-27T09:30:45.081531+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T09:30:46.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[9772]: cluster 2021-01-27T09:30:46.022190+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:46.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[13570]: cluster 2021-01-27T09:30:44.408135+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v523: 332 pgs: 6 creating+activating, 12 creating+peering, 66 unknown, 248 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:46.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[13570]: audit 2021-01-27T09:30:45.081216+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:46.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[13570]: cluster 2021-01-27T09:30:45.081531+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T09:30:46.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:46 smithi103 bash[13570]: cluster 2021-01-27T09:30:46.022190+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:46.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:46 smithi047 bash[9721]: cluster 2021-01-27T09:30:44.408135+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v523: 332 pgs: 6 creating+activating, 12 creating+peering, 66 unknown, 248 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:46.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:46 smithi047 bash[9721]: audit 2021-01-27T09:30:45.081216+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:46.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:46 smithi047 bash[9721]: cluster 2021-01-27T09:30:45.081531+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T09:30:46.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:46 smithi047 bash[9721]: cluster 2021-01-27T09:30:46.022190+0000 mon.a (mon.0) 1436 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:30:47.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[13570]: cluster 2021-01-27T09:30:46.094533+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T09:30:47.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[13570]: audit 2021-01-27T09:30:46.099053+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[13570]: audit 2021-01-27T09:30:46.099950+0000 mon.b (mon.2) 119 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:47.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[13570]: audit 2021-01-27T09:30:46.100001+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[13570]: audit 2021-01-27T09:30:46.103078+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:47.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[9772]: cluster 2021-01-27T09:30:46.094533+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T09:30:47.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[9772]: audit 2021-01-27T09:30:46.099053+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[9772]: audit 2021-01-27T09:30:46.099950+0000 mon.b (mon.2) 119 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:47.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[9772]: audit 2021-01-27T09:30:46.100001+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:47 smithi103 bash[9772]: audit 2021-01-27T09:30:46.103078+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:47.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:47 smithi047 bash[9721]: cluster 2021-01-27T09:30:46.094533+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T09:30:47.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:47 smithi047 bash[9721]: audit 2021-01-27T09:30:46.099053+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:47 smithi047 bash[9721]: audit 2021-01-27T09:30:46.099950+0000 mon.b (mon.2) 119 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:47.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:47 smithi047 bash[9721]: audit 2021-01-27T09:30:46.100001+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:47.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:47 smithi047 bash[9721]: audit 2021-01-27T09:30:46.103078+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:48.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: cluster 2021-01-27T09:30:46.409236+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v526: 292 pgs: 6 creating+activating, 13 creating+peering, 31 unknown, 242 active+clean; 26 KiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:48.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.105946+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:48.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.106517+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:48.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: cluster 2021-01-27T09:30:47.106765+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T09:30:48.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.108492+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.117489+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.139054+0000 mon.b (mon.2) 120 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:48.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[9772]: audit 2021-01-27T09:30:47.140312+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:48.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: cluster 2021-01-27T09:30:46.409236+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v526: 292 pgs: 6 creating+activating, 13 creating+peering, 31 unknown, 242 active+clean; 26 KiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:48.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.105946+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:48.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.106517+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:48.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: cluster 2021-01-27T09:30:47.106765+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T09:30:48.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.108492+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.117489+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.139054+0000 mon.b (mon.2) 120 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:48.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:48 smithi103 bash[13570]: audit 2021-01-27T09:30:47.140312+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:48.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: cluster 2021-01-27T09:30:46.409236+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v526: 292 pgs: 6 creating+activating, 13 creating+peering, 31 unknown, 242 active+clean; 26 KiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:30:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.105946+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.106517+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:48.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: cluster 2021-01-27T09:30:47.106765+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T09:30:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.108492+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.103:0/3505181131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.117489+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]: dispatch 2021-01-27T09:30:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.139054+0000 mon.b (mon.2) 120 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:48.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:48 smithi047 bash[9721]: audit 2021-01-27T09:30:47.140312+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:49.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.110792+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:49.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.111074+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:49.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: cluster 2021-01-27T09:30:48.111241+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T09:30:49.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.121559+0000 mon.b (mon.2) 121 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.122790+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.144943+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.581121+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.582168+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.582600+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.583520+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:49.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[9772]: audit 2021-01-27T09:30:48.584062+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:49.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.110792+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:49.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.111074+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:49.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: cluster 2021-01-27T09:30:48.111241+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T09:30:49.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.121559+0000 mon.b (mon.2) 121 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.122790+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.144943+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.581121+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.582168+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.582600+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.583520+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:49.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:49 smithi103 bash[13570]: audit 2021-01-27T09:30:48.584062+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:49.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.110792+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-30"}]': finished 2021-01-27T09:30:49.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.111074+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:49.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: cluster 2021-01-27T09:30:48.111241+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T09:30:49.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.121559+0000 mon.b (mon.2) 121 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.122790+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.144943+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.581121+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.582168+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.582600+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.583520+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:49.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:49 smithi047 bash[9721]: audit 2021-01-27T09:30:48.584062+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:50.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: cluster 2021-01-27T09:30:48.410463+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v529: 228 pgs: 1 creating+peering, 10 unknown, 217 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:50.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.136218+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:50.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.136398+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:50.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: cluster 2021-01-27T09:30:49.136522+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T09:30:50.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.138635+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.139055+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.103:0/650968837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.139824+0000 mon.b (mon.2) 122 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:50.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.140230+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.141324+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[9772]: audit 2021-01-27T09:30:49.142885+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:50.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: cluster 2021-01-27T09:30:48.410463+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v529: 228 pgs: 1 creating+peering, 10 unknown, 217 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:50.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.136218+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.136398+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: cluster 2021-01-27T09:30:49.136522+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T09:30:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.138635+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.139055+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.103:0/650968837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.139824+0000 mon.b (mon.2) 122 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:50.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.140230+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.141324+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:50 smithi103 bash[13570]: audit 2021-01-27T09:30:49.142885+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:50.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: cluster 2021-01-27T09:30:48.410463+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v529: 228 pgs: 1 creating+peering, 10 unknown, 217 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T09:30:50.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.136218+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:50.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.136398+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:50.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: cluster 2021-01-27T09:30:49.136522+0000 mon.a (mon.0) 1454 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T09:30:50.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.138635+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.139055+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.103:0/650968837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.139824+0000 mon.b (mon.2) 122 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:50.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.140230+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:50.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.141324+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:50.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:50 smithi047 bash[9721]: audit 2021-01-27T09:30:49.142885+0000 mon.a (mon.0) 1457 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]: dispatch 2021-01-27T09:30:51.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: cluster 2021-01-27T09:30:50.133806+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:51.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: audit 2021-01-27T09:30:50.562314+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:51.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: audit 2021-01-27T09:30:50.562620+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]': finished 2021-01-27T09:30:51.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: cluster 2021-01-27T09:30:50.563253+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T09:30:51.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: audit 2021-01-27T09:30:50.678618+0000 mon.b (mon.2) 123 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:51.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[13570]: audit 2021-01-27T09:30:51.052291+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:51.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: cluster 2021-01-27T09:30:50.133806+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:51.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: audit 2021-01-27T09:30:50.562314+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:51.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: audit 2021-01-27T09:30:50.562620+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]': finished 2021-01-27T09:30:51.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: cluster 2021-01-27T09:30:50.563253+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T09:30:51.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: audit 2021-01-27T09:30:50.678618+0000 mon.b (mon.2) 123 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:51.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:51 smithi103 bash[9772]: audit 2021-01-27T09:30:51.052291+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:51.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: cluster 2021-01-27T09:30:50.133806+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:30:51.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: audit 2021-01-27T09:30:50.562314+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:51.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: audit 2021-01-27T09:30:50.562620+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-21", "mode": "writeback"}]': finished 2021-01-27T09:30:51.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: cluster 2021-01-27T09:30:50.563253+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T09:30:51.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: audit 2021-01-27T09:30:50.678618+0000 mon.b (mon.2) 123 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:51.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:51 smithi047 bash[9721]: audit 2021-01-27T09:30:51.052291+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:30:52.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: cluster 2021-01-27T09:30:50.411258+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v532: 260 pgs: 10 creating+peering, 23 unknown, 227 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: audit 2021-01-27T09:30:51.155433+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: audit 2021-01-27T09:30:51.155546+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: cluster 2021-01-27T09:30:51.155603+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T09:30:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: audit 2021-01-27T09:30:51.158169+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: audit 2021-01-27T09:30:51.159337+0000 mon.b (mon.2) 124 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:52 smithi047 bash[9721]: audit 2021-01-27T09:30:51.161446+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:52.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: cluster 2021-01-27T09:30:50.411258+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v532: 260 pgs: 10 creating+peering, 23 unknown, 227 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:52.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: audit 2021-01-27T09:30:51.155433+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:52.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: audit 2021-01-27T09:30:51.155546+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:52.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: cluster 2021-01-27T09:30:51.155603+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T09:30:52.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: audit 2021-01-27T09:30:51.158169+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:52.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: audit 2021-01-27T09:30:51.159337+0000 mon.b (mon.2) 124 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:52.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[13570]: audit 2021-01-27T09:30:51.161446+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: cluster 2021-01-27T09:30:50.411258+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v532: 260 pgs: 10 creating+peering, 23 unknown, 227 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:30:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: audit 2021-01-27T09:30:51.155433+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: audit 2021-01-27T09:30:51.155546+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:30:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: cluster 2021-01-27T09:30:51.155603+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T09:30:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: audit 2021-01-27T09:30:51.158169+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: audit 2021-01-27T09:30:51.159337+0000 mon.b (mon.2) 124 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:52.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:52 smithi103 bash[9772]: audit 2021-01-27T09:30:51.161446+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]: dispatch 2021-01-27T09:30:53.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:53 smithi047 bash[9721]: cluster 2021-01-27T09:30:52.153701+0000 mon.a (mon.0) 1468 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:53.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:53 smithi047 bash[9721]: audit 2021-01-27T09:30:52.168571+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:53.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:53 smithi047 bash[9721]: audit 2021-01-27T09:30:52.168692+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:53.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:53 smithi047 bash[9721]: cluster 2021-01-27T09:30:52.169116+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T09:30:53.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[9772]: cluster 2021-01-27T09:30:52.153701+0000 mon.a (mon.0) 1468 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:53.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[9772]: audit 2021-01-27T09:30:52.168571+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:53.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[9772]: audit 2021-01-27T09:30:52.168692+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:53.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[9772]: cluster 2021-01-27T09:30:52.169116+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T09:30:53.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[13570]: cluster 2021-01-27T09:30:52.153701+0000 mon.a (mon.0) 1468 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:30:53.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[13570]: audit 2021-01-27T09:30:52.168571+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.103:0/3152615208' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:53.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[13570]: audit 2021-01-27T09:30:52.168692+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-21"}]': finished 2021-01-27T09:30:53.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:53 smithi103 bash[13570]: cluster 2021-01-27T09:30:52.169116+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T09:30:54.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:30:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: cluster 2021-01-27T09:30:52.412121+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v535: 300 pgs: 11 creating+peering, 61 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T09:30:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: cluster 2021-01-27T09:30:53.179264+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T09:30:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: audit 2021-01-27T09:30:53.181871+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: audit 2021-01-27T09:30:53.182408+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.103:0/227986691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: audit 2021-01-27T09:30:53.184436+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:54 smithi047 bash[9721]: audit 2021-01-27T09:30:53.184833+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:54.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: cluster 2021-01-27T09:30:52.412121+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v535: 300 pgs: 11 creating+peering, 61 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T09:30:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: cluster 2021-01-27T09:30:53.179264+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T09:30:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: audit 2021-01-27T09:30:53.181871+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: audit 2021-01-27T09:30:53.182408+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.103:0/227986691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: audit 2021-01-27T09:30:53.184436+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[13570]: audit 2021-01-27T09:30:53.184833+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:54.646 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[10018]: debug 2021-01-27T09:30:54.209+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:30:54.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: cluster 2021-01-27T09:30:52.412121+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v535: 300 pgs: 11 creating+peering, 61 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T09:30:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: cluster 2021-01-27T09:30:53.179264+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T09:30:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: audit 2021-01-27T09:30:53.181871+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: audit 2021-01-27T09:30:53.182408+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.103:0/227986691' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: audit 2021-01-27T09:30:53.184436+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:54.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:54 smithi103 bash[9772]: audit 2021-01-27T09:30:53.184833+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.189432+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.189581+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: cluster 2021-01-27T09:30:54.190419+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T09:30:55.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.191510+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.195184+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.197657+0000 mon.b (mon.2) 125 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.209608+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:54.212421+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:55.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:55.192840+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: audit 2021-01-27T09:30:55.193483+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:55 smithi047 bash[9721]: cluster 2021-01-27T09:30:55.194174+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T09:30:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.189432+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.189581+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: cluster 2021-01-27T09:30:54.190419+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T09:30:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.191510+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.195184+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.197657+0000 mon.b (mon.2) 125 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.209608+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:54.212421+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:55.192840+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: audit 2021-01-27T09:30:55.193483+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[9772]: cluster 2021-01-27T09:30:55.194174+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T09:30:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.189432+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.189581+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: cluster 2021-01-27T09:30:54.190419+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T09:30:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.191510+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.103:0/4225784860' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.195184+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]: dispatch 2021-01-27T09:30:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.197657+0000 mon.b (mon.2) 125 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.209608+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:54.212421+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:30:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:55.192840+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-31"}]': finished 2021-01-27T09:30:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: audit 2021-01-27T09:30:55.193483+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:55.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:55 smithi103 bash[13570]: cluster 2021-01-27T09:30:55.194174+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T09:30:56.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: cluster 2021-01-27T09:30:54.413339+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v538: 324 pgs: 22 creating+peering, 54 unknown, 248 active+clean; 27 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:56.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.197102+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.103:0/2236042962' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.199953+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.243705+0000 mon.b (mon.2) 126 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.244731+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.244972+0000 mon.b (mon.2) 127 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.245913+0000 mon.b (mon.2) 128 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.245921+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:55.246861+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:56.197463+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:56.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:56.198445+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:56.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: cluster 2021-01-27T09:30:56.198633+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T09:30:56.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:56.202452+0000 mon.b (mon.2) 129 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:56 smithi047 bash[9721]: audit 2021-01-27T09:30:56.203980+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: cluster 2021-01-27T09:30:54.413339+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v538: 324 pgs: 22 creating+peering, 54 unknown, 248 active+clean; 27 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:56.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.197102+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.103:0/2236042962' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.199953+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.243705+0000 mon.b (mon.2) 126 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.244731+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.244972+0000 mon.b (mon.2) 127 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.245913+0000 mon.b (mon.2) 128 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.245921+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:55.246861+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:56.197463+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:56.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:56.198445+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:56.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: cluster 2021-01-27T09:30:56.198633+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T09:30:56.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:56.202452+0000 mon.b (mon.2) 129 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[13570]: audit 2021-01-27T09:30:56.203980+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: cluster 2021-01-27T09:30:54.413339+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v538: 324 pgs: 22 creating+peering, 54 unknown, 248 active+clean; 27 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:30:56.655 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.197102+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.103:0/2236042962' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.199953+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:56.656 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.243705+0000 mon.b (mon.2) 126 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.659 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.244731+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.660 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.244972+0000 mon.b (mon.2) 127 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.660 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.245913+0000 mon.b (mon.2) 128 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.660 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.245921+0000 mon.a (mon.0) 1485 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.661 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:55.246861+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:30:56.661 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:56.197463+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:56.661 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:56.198445+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:30:56.662 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: cluster 2021-01-27T09:30:56.198633+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T09:30:56.662 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:56.202452+0000 mon.b (mon.2) 129 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:56.662 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:56 smithi103 bash[9772]: audit 2021-01-27T09:30:56.203980+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:30:57.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:57 smithi103 bash[9772]: audit 2021-01-27T09:30:56.243723+0000 mon.b (mon.2) 130 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:57.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:57 smithi103 bash[9772]: audit 2021-01-27T09:30:56.244772+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:57.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:57 smithi103 bash[13570]: audit 2021-01-27T09:30:56.243723+0000 mon.b (mon.2) 130 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:57.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:57 smithi103 bash[13570]: audit 2021-01-27T09:30:56.244772+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:58.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:57 smithi047 bash[9721]: audit 2021-01-27T09:30:56.243723+0000 mon.b (mon.2) 130 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:58.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:57 smithi047 bash[9721]: audit 2021-01-27T09:30:56.244772+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:30:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: cluster 2021-01-27T09:30:56.414472+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v541: 356 pgs: 20 creating+peering, 51 unknown, 285 active+clean; 27 KiB data, 334 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-27T09:30:59.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:57.625513+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: cluster 2021-01-27T09:30:57.625768+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T09:30:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:57.626543+0000 mon.b (mon.2) 131 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:57.627558+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.103:0/3870838336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:57.629250+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:57.639878+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:58.208924+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:30:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:58.210306+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:30:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:58.210871+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:59.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: cluster 2021-01-27T09:30:58.210986+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T09:30:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:58.212285+0000 mon.b (mon.2) 132 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:30:59.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:58 smithi047 bash[9721]: audit 2021-01-27T09:30:58.214595+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:30:59.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: cluster 2021-01-27T09:30:56.414472+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v541: 356 pgs: 20 creating+peering, 51 unknown, 285 active+clean; 27 KiB data, 334 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-27T09:30:59.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:57.625513+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:59.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: cluster 2021-01-27T09:30:57.625768+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T09:30:59.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:57.626543+0000 mon.b (mon.2) 131 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:57.627558+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.103:0/3870838336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:57.629250+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:57.639878+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:58.208924+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:30:59.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:58.210306+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:30:59.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:58.210871+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:59.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: cluster 2021-01-27T09:30:58.210986+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T09:30:59.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:58.212285+0000 mon.b (mon.2) 132 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:30:59.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[9772]: audit 2021-01-27T09:30:58.214595+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:30:59.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: cluster 2021-01-27T09:30:56.414472+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v541: 356 pgs: 20 creating+peering, 51 unknown, 285 active+clean; 27 KiB data, 334 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-27T09:30:59.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:57.625513+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:30:59.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: cluster 2021-01-27T09:30:57.625768+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T09:30:59.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:57.626543+0000 mon.b (mon.2) 131 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:57.627558+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.103:0/3870838336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:57.629250+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:30:59.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:57.639878+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:30:59.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:58.208924+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:30:59.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:58.210306+0000 mon.a (mon.0) 1497 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:30:59.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:58.210871+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:30:59.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: cluster 2021-01-27T09:30:58.210986+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T09:30:59.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:58.212285+0000 mon.b (mon.2) 132 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:30:59.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:58 smithi103 bash[13570]: audit 2021-01-27T09:30:58.214595+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]: dispatch 2021-01-27T09:31:00.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: cluster 2021-01-27T09:30:58.416338+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v544: 396 pgs: 17 creating+peering, 26 unknown, 353 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-27T09:31:00.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: audit 2021-01-27T09:30:58.697421+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: audit 2021-01-27T09:30:58.725897+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: cluster 2021-01-27T09:30:59.200036+0000 mon.a (mon.0) 1503 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: audit 2021-01-27T09:30:59.209510+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]': finished 2021-01-27T09:31:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:30:59 smithi047 bash[9721]: cluster 2021-01-27T09:30:59.210057+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T09:31:00.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: cluster 2021-01-27T09:30:58.416338+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v544: 396 pgs: 17 creating+peering, 26 unknown, 353 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-27T09:31:00.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: audit 2021-01-27T09:30:58.697421+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:00.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: audit 2021-01-27T09:30:58.725897+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:00.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: cluster 2021-01-27T09:30:59.200036+0000 mon.a (mon.0) 1503 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:00.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: audit 2021-01-27T09:30:59.209510+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]': finished 2021-01-27T09:31:00.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[13570]: cluster 2021-01-27T09:30:59.210057+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T09:31:00.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: cluster 2021-01-27T09:30:58.416338+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v544: 396 pgs: 17 creating+peering, 26 unknown, 353 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-27T09:31:00.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: audit 2021-01-27T09:30:58.697421+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: audit 2021-01-27T09:30:58.725897+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: cluster 2021-01-27T09:30:59.200036+0000 mon.a (mon.0) 1503 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: audit 2021-01-27T09:30:59.209510+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-23", "mode": "writeback"}]': finished 2021-01-27T09:31:00.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:30:59 smithi103 bash[9772]: cluster 2021-01-27T09:30:59.210057+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T09:31:00.551 INFO:journalctl@ceph.osd.5.smithi047.stdout:Jan 27 09:31:00 smithi047 bash[15060]: debug 2021-01-27T09:31:00.258+0000 7f5d26412700 -1 osd.5 pg_epoch: 196 pg[63.1f( v 192'71 (0'0,192'71] local-lis/les=80/81 n=6 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [5,0,1] r=0 lpr=80 crt=192'71 lcod 191'69 mlcod 191'69 active+clean+snaptrim trimq=[e~1]] removing snap head 2021-01-27T09:31:01.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:01 smithi047 bash[9721]: cluster 2021-01-27T09:31:00.226218+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T09:31:01.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:01 smithi047 bash[9721]: audit 2021-01-27T09:31:00.231873+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:01 smithi047 bash[9721]: audit 2021-01-27T09:31:00.233043+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:01 smithi047 bash[9721]: audit 2021-01-27T09:31:00.305542+0000 mon.b (mon.2) 134 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:01.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:01 smithi047 bash[9721]: audit 2021-01-27T09:31:00.306965+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:01.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[13570]: cluster 2021-01-27T09:31:00.226218+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T09:31:01.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[13570]: audit 2021-01-27T09:31:00.231873+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[13570]: audit 2021-01-27T09:31:00.233043+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[13570]: audit 2021-01-27T09:31:00.305542+0000 mon.b (mon.2) 134 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:01.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[13570]: audit 2021-01-27T09:31:00.306965+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:01.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[9772]: cluster 2021-01-27T09:31:00.226218+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T09:31:01.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[9772]: audit 2021-01-27T09:31:00.231873+0000 mon.b (mon.2) 133 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[9772]: audit 2021-01-27T09:31:00.233043+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:01.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[9772]: audit 2021-01-27T09:31:00.305542+0000 mon.b (mon.2) 134 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:01.654 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:01 smithi103 bash[9772]: audit 2021-01-27T09:31:00.306965+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: cluster 2021-01-27T09:31:00.417334+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v547: 324 pgs: 324 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-01-27T09:31:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.230152+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.230369+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: cluster 2021-01-27T09:31:01.230509+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T09:31:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.233772+0000 mon.b (mon.2) 135 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.235533+0000 mon.b (mon.2) 136 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.245203+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:02 smithi047 bash[9721]: audit 2021-01-27T09:31:01.245578+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:02.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: cluster 2021-01-27T09:31:00.417334+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v547: 324 pgs: 324 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-01-27T09:31:02.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.230152+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:02.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.230369+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:02.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: cluster 2021-01-27T09:31:01.230509+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T09:31:02.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.233772+0000 mon.b (mon.2) 135 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.235533+0000 mon.b (mon.2) 136 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:02.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.245203+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[13570]: audit 2021-01-27T09:31:01.245578+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:02.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: cluster 2021-01-27T09:31:00.417334+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v547: 324 pgs: 324 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-01-27T09:31:02.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.230152+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:02.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.230369+0000 mon.a (mon.0) 1510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:02.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: cluster 2021-01-27T09:31:01.230509+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T09:31:02.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.233772+0000 mon.b (mon.2) 135 : audit [INF] from='client.? 172.21.15.103:0/1699711190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.235533+0000 mon.b (mon.2) 136 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.245203+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]: dispatch 2021-01-27T09:31:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:02 smithi103 bash[9772]: audit 2021-01-27T09:31:01.245578+0000 mon.a (mon.0) 1513 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]: dispatch 2021-01-27T09:31:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: cluster 2021-01-27T09:31:02.238462+0000 mon.a (mon.0) 1514 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: audit 2021-01-27T09:31:02.253079+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: audit 2021-01-27T09:31:02.253173+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:31:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: cluster 2021-01-27T09:31:02.253254+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T09:31:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: audit 2021-01-27T09:31:02.275732+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: audit 2021-01-27T09:31:02.276774+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:03 smithi047 bash[9721]: audit 2021-01-27T09:31:02.277330+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: cluster 2021-01-27T09:31:02.238462+0000 mon.a (mon.0) 1514 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: audit 2021-01-27T09:31:02.253079+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:03.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: audit 2021-01-27T09:31:02.253173+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:31:03.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: cluster 2021-01-27T09:31:02.253254+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T09:31:03.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: audit 2021-01-27T09:31:02.275732+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: audit 2021-01-27T09:31:02.276774+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[13570]: audit 2021-01-27T09:31:02.277330+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: cluster 2021-01-27T09:31:02.238462+0000 mon.a (mon.0) 1514 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: audit 2021-01-27T09:31:02.253079+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-32"}]': finished 2021-01-27T09:31:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: audit 2021-01-27T09:31:02.253173+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-23"}]': finished 2021-01-27T09:31:03.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: cluster 2021-01-27T09:31:02.253254+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T09:31:03.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: audit 2021-01-27T09:31:02.275732+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: audit 2021-01-27T09:31:02.276774+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:03.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:03 smithi103 bash[9772]: audit 2021-01-27T09:31:02.277330+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:04.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:04.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[10018]: debug 2021-01-27T09:31:04.217+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:05.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:04 smithi047 bash[9721]: cluster 2021-01-27T09:31:02.418292+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v550: 260 pgs: 260 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-27T09:31:05.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:04 smithi047 bash[9721]: audit 2021-01-27T09:31:03.261453+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:05.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:04 smithi047 bash[9721]: cluster 2021-01-27T09:31:03.261612+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T09:31:05.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:04 smithi047 bash[9721]: audit 2021-01-27T09:31:03.263170+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:05.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[9772]: cluster 2021-01-27T09:31:02.418292+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v550: 260 pgs: 260 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-27T09:31:05.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[9772]: audit 2021-01-27T09:31:03.261453+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:05.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[9772]: cluster 2021-01-27T09:31:03.261612+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T09:31:05.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[9772]: audit 2021-01-27T09:31:03.263170+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:05.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[13570]: cluster 2021-01-27T09:31:02.418292+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v550: 260 pgs: 260 active+clean; 27 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-27T09:31:05.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[13570]: audit 2021-01-27T09:31:03.261453+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:05.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[13570]: cluster 2021-01-27T09:31:03.261612+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T09:31:05.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:04 smithi103 bash[13570]: audit 2021-01-27T09:31:03.263170+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:06.051 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:04.220578+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: cluster 2021-01-27T09:31:04.419214+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v553: 260 pgs: 64 unknown, 196 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: cluster 2021-01-27T09:31:04.680023+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T09:31:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:04.681408+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:04.681912+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.103:0/2050400679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:04.696752+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:04.698375+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:05.277417+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:05.277850+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: audit 2021-01-27T09:31:05.277962+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:05 smithi047 bash[9721]: cluster 2021-01-27T09:31:05.278094+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T09:31:06.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:04.220578+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:06.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: cluster 2021-01-27T09:31:04.419214+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v553: 260 pgs: 64 unknown, 196 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:06.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: cluster 2021-01-27T09:31:04.680023+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T09:31:06.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:04.681408+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:04.681912+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.103:0/2050400679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:04.696752+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:04.698375+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:05.277417+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:05.277850+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: audit 2021-01-27T09:31:05.277962+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[9772]: cluster 2021-01-27T09:31:05.278094+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T09:31:06.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:04.220578+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:06.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: cluster 2021-01-27T09:31:04.419214+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v553: 260 pgs: 64 unknown, 196 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:06.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: cluster 2021-01-27T09:31:04.680023+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T09:31:06.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:04.681408+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:04.681912+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.103:0/2050400679' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:04.696752+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:04.698375+0000 mon.a (mon.0) 1526 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:06.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:05.277417+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:06.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:05.277850+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: audit 2021-01-27T09:31:05.277962+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:06.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:05 smithi103 bash[13570]: cluster 2021-01-27T09:31:05.278094+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T09:31:07.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:07 smithi047 bash[9721]: cluster 2021-01-27T09:31:06.285384+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T09:31:07.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:07 smithi047 bash[9721]: audit 2021-01-27T09:31:06.306819+0000 mon.b (mon.2) 138 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:07.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:07 smithi047 bash[9721]: audit 2021-01-27T09:31:06.308570+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:07.643 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[9772]: cluster 2021-01-27T09:31:06.285384+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T09:31:07.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[9772]: audit 2021-01-27T09:31:06.306819+0000 mon.b (mon.2) 138 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:07.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[9772]: audit 2021-01-27T09:31:06.308570+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:07.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[13570]: cluster 2021-01-27T09:31:06.285384+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T09:31:07.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[13570]: audit 2021-01-27T09:31:06.306819+0000 mon.b (mon.2) 138 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:07.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:07 smithi103 bash[13570]: audit 2021-01-27T09:31:06.308570+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:08.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: cluster 2021-01-27T09:31:06.420218+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v556: 236 pgs: 7 creating+peering, 29 unknown, 200 active+clean; 26 KiB data, 347 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T09:31:08.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.288140+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:08.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: cluster 2021-01-27T09:31:07.288322+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T09:31:08.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.291435+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:08.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.295714+0000 mon.b (mon.2) 139 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.306361+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.312617+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.103:0/77344155' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:08.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[9772]: audit 2021-01-27T09:31:07.313032+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:08.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: cluster 2021-01-27T09:31:06.420218+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v556: 236 pgs: 7 creating+peering, 29 unknown, 200 active+clean; 26 KiB data, 347 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T09:31:08.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.288140+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:08.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: cluster 2021-01-27T09:31:07.288322+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T09:31:08.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.291435+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.295714+0000 mon.b (mon.2) 139 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.306361+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.312617+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.103:0/77344155' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:08 smithi103 bash[13570]: audit 2021-01-27T09:31:07.313032+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:08.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: cluster 2021-01-27T09:31:06.420218+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v556: 236 pgs: 7 creating+peering, 29 unknown, 200 active+clean; 26 KiB data, 347 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T09:31:08.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.288140+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:08.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: cluster 2021-01-27T09:31:07.288322+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T09:31:08.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.291435+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:08.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.295714+0000 mon.b (mon.2) 139 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.306361+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:08.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.312617+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.103:0/77344155' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:08.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:08 smithi047 bash[9721]: audit 2021-01-27T09:31:07.313032+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:09.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.296276+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.297224+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:09.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.297852+0000 mon.b (mon.2) 140 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.297987+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: cluster 2021-01-27T09:31:08.298623+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T09:31:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.308709+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:08.309375+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: cluster 2021-01-27T09:31:08.421638+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v559: 260 pgs: 9 creating+peering, 20 unknown, 231 active+clean; 27 KiB data, 349 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: cluster 2021-01-27T09:31:09.284594+0000 mon.a (mon.0) 1544 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:09.292368+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: audit 2021-01-27T09:31:09.292503+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]': finished 2021-01-27T09:31:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[9772]: cluster 2021-01-27T09:31:09.292682+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T09:31:09.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.296276+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.297224+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:09.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.297852+0000 mon.b (mon.2) 140 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.297987+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:09.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: cluster 2021-01-27T09:31:08.298623+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T09:31:09.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.308709+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:09.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:08.309375+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: cluster 2021-01-27T09:31:08.421638+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v559: 260 pgs: 9 creating+peering, 20 unknown, 231 active+clean; 27 KiB data, 349 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:09.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: cluster 2021-01-27T09:31:09.284594+0000 mon.a (mon.0) 1544 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:09.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:09.292368+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: audit 2021-01-27T09:31:09.292503+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]': finished 2021-01-27T09:31:09.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:09 smithi103 bash[13570]: cluster 2021-01-27T09:31:09.292682+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T09:31:09.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.296276+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.297224+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:09.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.297852+0000 mon.b (mon.2) 140 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.297987+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:09.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: cluster 2021-01-27T09:31:08.298623+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T09:31:09.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.308709+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]: dispatch 2021-01-27T09:31:09.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:08.309375+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]: dispatch 2021-01-27T09:31:09.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: cluster 2021-01-27T09:31:08.421638+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v559: 260 pgs: 9 creating+peering, 20 unknown, 231 active+clean; 27 KiB data, 349 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:09.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: cluster 2021-01-27T09:31:09.284594+0000 mon.a (mon.0) 1544 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:09.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:09.292368+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.103:0/4221004347' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-33"}]': finished 2021-01-27T09:31:09.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: audit 2021-01-27T09:31:09.292503+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-25", "mode": "writeback"}]': finished 2021-01-27T09:31:09.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:09 smithi047 bash[9721]: cluster 2021-01-27T09:31:09.292682+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T09:31:10.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.327542+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.327898+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.331662+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.332060+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.332779+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.333110+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.333231+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.333941+0000 mon.a (mon.0) 1551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.334337+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.335068+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.335196+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.335808+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.359617+0000 mon.b (mon.2) 141 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:10.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[9772]: audit 2021-01-27T09:31:09.360850+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:10.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.327542+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.327898+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.331662+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.332060+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.332779+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.333110+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.333231+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.333941+0000 mon.a (mon.0) 1551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.334337+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.335068+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.335196+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.335808+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.359617+0000 mon.b (mon.2) 141 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:10.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:10 smithi103 bash[13570]: audit 2021-01-27T09:31:09.360850+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:10.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.327542+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.327898+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.331662+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.332060+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.332779+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.333110+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.333231+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:10.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.333941+0000 mon.a (mon.0) 1551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:10.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.334337+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.335068+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.335196+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.335808+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:10.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.359617+0000 mon.b (mon.2) 141 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:10.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:10 smithi047 bash[9721]: audit 2021-01-27T09:31:09.360850+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:12.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.332115+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.332319+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.332425+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:12.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: cluster 2021-01-27T09:31:10.332511+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T09:31:12.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.333189+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.333623+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.333801+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.334735+0000 mon.b (mon.2) 142 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.342827+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: audit 2021-01-27T09:31:10.343494+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:11 smithi047 bash[9721]: cluster 2021-01-27T09:31:11.059547+0000 mon.a (mon.0) 1562 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.332115+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.332319+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.332425+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:12.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: cluster 2021-01-27T09:31:10.332511+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T09:31:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.333189+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.333623+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.333801+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.334735+0000 mon.b (mon.2) 142 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.342827+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: audit 2021-01-27T09:31:10.343494+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[13570]: cluster 2021-01-27T09:31:11.059547+0000 mon.a (mon.0) 1562 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.332115+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.332319+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.332425+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: cluster 2021-01-27T09:31:10.332511+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T09:31:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.333189+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.333623+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:12.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.333801+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.334735+0000 mon.b (mon.2) 142 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.342827+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]: dispatch 2021-01-27T09:31:12.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: audit 2021-01-27T09:31:10.343494+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:12.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:11 smithi103 bash[9772]: cluster 2021-01-27T09:31:11.059547+0000 mon.a (mon.0) 1562 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:13.301 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: cluster 2021-01-27T09:31:10.422553+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v562: 228 pgs: 228 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: audit 2021-01-27T09:31:11.491296+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: cluster 2021-01-27T09:31:11.914382+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T09:31:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: audit 2021-01-27T09:31:12.071534+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:13.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: audit 2021-01-27T09:31:12.071887+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:13.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:12 smithi047 bash[9721]: cluster 2021-01-27T09:31:12.072271+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T09:31:13.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: cluster 2021-01-27T09:31:10.422553+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v562: 228 pgs: 228 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:13.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: audit 2021-01-27T09:31:11.491296+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:13.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: cluster 2021-01-27T09:31:11.914382+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T09:31:13.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: audit 2021-01-27T09:31:12.071534+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:13.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: audit 2021-01-27T09:31:12.071887+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:13.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[13570]: cluster 2021-01-27T09:31:12.072271+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T09:31:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: cluster 2021-01-27T09:31:10.422553+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v562: 228 pgs: 228 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:13.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: audit 2021-01-27T09:31:11.491296+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-25"}]': finished 2021-01-27T09:31:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: cluster 2021-01-27T09:31:11.914382+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T09:31:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: audit 2021-01-27T09:31:12.071534+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: audit 2021-01-27T09:31:12.071887+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:13.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:12 smithi103 bash[9772]: cluster 2021-01-27T09:31:12.072271+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T09:31:14.393 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[10018]: debug 2021-01-27T09:31:14.225+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:14.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[9772]: cluster 2021-01-27T09:31:12.423323+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v565: 212 pgs: 16 unknown, 196 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:31:14.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[9772]: cluster 2021-01-27T09:31:13.079980+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T09:31:14.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[9772]: audit 2021-01-27T09:31:13.084349+0000 mon.b (mon.2) 143 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:14.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[9772]: audit 2021-01-27T09:31:13.086963+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[13570]: cluster 2021-01-27T09:31:12.423323+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v565: 212 pgs: 16 unknown, 196 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:31:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[13570]: cluster 2021-01-27T09:31:13.079980+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T09:31:14.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[13570]: audit 2021-01-27T09:31:13.084349+0000 mon.b (mon.2) 143 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:14.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:14 smithi103 bash[13570]: audit 2021-01-27T09:31:13.086963+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:14.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:14 smithi047 bash[9721]: cluster 2021-01-27T09:31:12.423323+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v565: 212 pgs: 16 unknown, 196 active+clean; 26 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-27T09:31:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:14 smithi047 bash[9721]: cluster 2021-01-27T09:31:13.079980+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T09:31:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:14 smithi047 bash[9721]: audit 2021-01-27T09:31:13.084349+0000 mon.b (mon.2) 143 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:14 smithi047 bash[9721]: audit 2021-01-27T09:31:13.086963+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:15.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.084622+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: cluster 2021-01-27T09:31:14.085474+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T09:31:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.088121+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.088890+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.091116+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.101374+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:14.228168+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:15.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:15.085099+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:15.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:15.085301+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:15.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: cluster 2021-01-27T09:31:15.085545+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T09:31:15.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:15.089047+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:15.089298+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[9772]: audit 2021-01-27T09:31:15.089664+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.084622+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:15.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: cluster 2021-01-27T09:31:14.085474+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T09:31:15.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.088121+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.088890+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.091116+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.101374+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:14.228168+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:15.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:15.085099+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:15.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:15.085301+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:15.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: cluster 2021-01-27T09:31:15.085545+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T09:31:15.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:15.089047+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:15.089298+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:15 smithi103 bash[13570]: audit 2021-01-27T09:31:15.089664+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.084622+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: cluster 2021-01-27T09:31:14.085474+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T09:31:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.088121+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.088890+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.091116+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.101374+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:14.228168+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:15.085099+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:15.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:15.085301+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:15.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: cluster 2021-01-27T09:31:15.085545+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T09:31:15.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:15.089047+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.103:0/1458017056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:15.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:15.089298+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.103:0/2966508872' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:15.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:15 smithi047 bash[9721]: audit 2021-01-27T09:31:15.089664+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]: dispatch 2021-01-27T09:31:16.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: cluster 2021-01-27T09:31:14.424379+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v568: 228 pgs: 13 creating+peering, 15 unknown, 200 active+clean; 26 KiB data, 339 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:31:16.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:15.090629+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:16.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:15.116717+0000 mon.b (mon.2) 144 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:15.117992+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:16.090898+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:16.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:16.091087+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:16.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: audit 2021-01-27T09:31:16.091207+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:16.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[9772]: cluster 2021-01-27T09:31:16.091280+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T09:31:16.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: cluster 2021-01-27T09:31:14.424379+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v568: 228 pgs: 13 creating+peering, 15 unknown, 200 active+clean; 26 KiB data, 339 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:31:16.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:15.090629+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:16.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:15.116717+0000 mon.b (mon.2) 144 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:15.117992+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:16.090898+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:16.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:16.091087+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:16.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: audit 2021-01-27T09:31:16.091207+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:16.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:16 smithi103 bash[13570]: cluster 2021-01-27T09:31:16.091280+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T09:31:16.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: cluster 2021-01-27T09:31:14.424379+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v568: 228 pgs: 13 creating+peering, 15 unknown, 200 active+clean; 26 KiB data, 339 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-27T09:31:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:15.090629+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]: dispatch 2021-01-27T09:31:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:15.116717+0000 mon.b (mon.2) 144 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:15.117992+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:16.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:16.090898+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-34"}]': finished 2021-01-27T09:31:16.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:16.091087+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-42"}]': finished 2021-01-27T09:31:16.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: audit 2021-01-27T09:31:16.091207+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:16.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:16 smithi047 bash[9721]: cluster 2021-01-27T09:31:16.091280+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T09:31:17.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.092024+0000 mon.b (mon.2) 145 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.094066+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.116994+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.117478+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.117560+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.118263+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.118455+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.118878+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.119222+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.119515+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.119704+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.120006+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.120222+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:16.120594+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[13570]: audit 2021-01-27T09:31:17.095516+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:17.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.092024+0000 mon.b (mon.2) 145 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.094066+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.116994+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.117478+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.117560+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.118263+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.118455+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.118878+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.119222+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.119515+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.119704+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.120006+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.400 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.120222+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:16.120594+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:17 smithi103 bash[9772]: audit 2021-01-27T09:31:17.095516+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.092024+0000 mon.b (mon.2) 145 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.094066+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.116994+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.117478+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.117560+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.118263+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.118455+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.118878+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:17.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.119222+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.119515+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:17.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.119704+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.120006+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.120222+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:16.120594+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:17.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:17 smithi047 bash[9721]: audit 2021-01-27T09:31:17.095516+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:19.302 INFO:journalctl@ceph.osd.4.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[12576]: debug 2021-01-27T09:31:19.126+0000 7f173db45700 -1 osd.4 pg_epoch: 215 pg[63.5( v 211'3 (0'0,211'3] local-lis/les=80/81 n=2 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [4,0,5] r=0 lpr=80 crt=211'3 lcod 210'1 mlcod 210'1 active+clean+snaptrim trimq=[11~1]] removing snap head 2021-01-27T09:31:19.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: cluster 2021-01-27T09:31:16.425600+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v571: 228 pgs: 13 creating+peering, 6 unknown, 209 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:19.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.095766+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.096007+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: cluster 2021-01-27T09:31:17.096229+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T09:31:19.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.097316+0000 mon.b (mon.2) 146 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.098366+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.098715+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.099072+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.099186+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.306 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: audit 2021-01-27T09:31:17.108238+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.307 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:18 smithi047 bash[9721]: cluster 2021-01-27T09:31:18.088056+0000 mon.a (mon.0) 1598 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:19.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: cluster 2021-01-27T09:31:16.425600+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v571: 228 pgs: 13 creating+peering, 6 unknown, 209 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:19.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.095766+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.096007+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: cluster 2021-01-27T09:31:17.096229+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T09:31:19.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.097316+0000 mon.b (mon.2) 146 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.098366+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.098715+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.099072+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.099186+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: audit 2021-01-27T09:31:17.108238+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[9772]: cluster 2021-01-27T09:31:18.088056+0000 mon.a (mon.0) 1598 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:19.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: cluster 2021-01-27T09:31:16.425600+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v571: 228 pgs: 13 creating+peering, 6 unknown, 209 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:19.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.095766+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.096007+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:19.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: cluster 2021-01-27T09:31:17.096229+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T09:31:19.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.097316+0000 mon.b (mon.2) 146 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.098366+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.098715+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]: dispatch 2021-01-27T09:31:19.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.099072+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.099186+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:19.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: audit 2021-01-27T09:31:17.108238+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:19.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:18 smithi103 bash[13570]: cluster 2021-01-27T09:31:18.088056+0000 mon.a (mon.0) 1598 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:20.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: audit 2021-01-27T09:31:18.096696+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]': finished 2021-01-27T09:31:20.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: cluster 2021-01-27T09:31:18.426828+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v574: 228 pgs: 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:20.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: cluster 2021-01-27T09:31:18.923927+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T09:31:20.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: audit 2021-01-27T09:31:19.102848+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:20.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: audit 2021-01-27T09:31:19.102959+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:20.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: cluster 2021-01-27T09:31:19.103070+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T09:31:20.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: audit 2021-01-27T09:31:19.149576+0000 mon.b (mon.2) 147 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:20.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:19 smithi047 bash[9721]: audit 2021-01-27T09:31:19.150895+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:20.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: audit 2021-01-27T09:31:18.096696+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]': finished 2021-01-27T09:31:20.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: cluster 2021-01-27T09:31:18.426828+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v574: 228 pgs: 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:20.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: cluster 2021-01-27T09:31:18.923927+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T09:31:20.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: audit 2021-01-27T09:31:19.102848+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:20.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: audit 2021-01-27T09:31:19.102959+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:20.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: cluster 2021-01-27T09:31:19.103070+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T09:31:20.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: audit 2021-01-27T09:31:19.149576+0000 mon.b (mon.2) 147 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:20.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[13570]: audit 2021-01-27T09:31:19.150895+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:20.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: audit 2021-01-27T09:31:18.096696+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-27", "mode": "writeback"}]': finished 2021-01-27T09:31:20.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: cluster 2021-01-27T09:31:18.426828+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v574: 228 pgs: 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-01-27T09:31:20.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: cluster 2021-01-27T09:31:18.923927+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T09:31:20.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: audit 2021-01-27T09:31:19.102848+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:20.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: audit 2021-01-27T09:31:19.102959+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:20.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: cluster 2021-01-27T09:31:19.103070+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T09:31:20.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: audit 2021-01-27T09:31:19.149576+0000 mon.b (mon.2) 147 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:20.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:19 smithi103 bash[9772]: audit 2021-01-27T09:31:19.150895+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:21.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[9772]: audit 2021-01-27T09:31:20.109197+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:21.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[9772]: cluster 2021-01-27T09:31:20.109379+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T09:31:21.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[9772]: audit 2021-01-27T09:31:20.117361+0000 mon.b (mon.2) 148 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:21.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[9772]: audit 2021-01-27T09:31:20.119640+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:21.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[13570]: audit 2021-01-27T09:31:20.109197+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:21.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[13570]: cluster 2021-01-27T09:31:20.109379+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T09:31:21.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[13570]: audit 2021-01-27T09:31:20.117361+0000 mon.b (mon.2) 148 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:21.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:21 smithi103 bash[13570]: audit 2021-01-27T09:31:20.119640+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:21.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:21 smithi047 bash[9721]: audit 2021-01-27T09:31:20.109197+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:21.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:21 smithi047 bash[9721]: cluster 2021-01-27T09:31:20.109379+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T09:31:21.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:21 smithi047 bash[9721]: audit 2021-01-27T09:31:20.117361+0000 mon.b (mon.2) 148 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:21.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:21 smithi047 bash[9721]: audit 2021-01-27T09:31:20.119640+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]: dispatch 2021-01-27T09:31:22.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: cluster 2021-01-27T09:31:20.427722+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v577: 244 pgs: 5 creating+peering, 11 unknown, 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:22.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: cluster 2021-01-27T09:31:21.101460+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:22.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: audit 2021-01-27T09:31:21.110785+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:22.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: cluster 2021-01-27T09:31:21.111074+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T09:31:22.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: audit 2021-01-27T09:31:21.113197+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: audit 2021-01-27T09:31:21.113688+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:22.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: audit 2021-01-27T09:31:21.120586+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[9772]: audit 2021-01-27T09:31:21.120930+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:22.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: cluster 2021-01-27T09:31:20.427722+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v577: 244 pgs: 5 creating+peering, 11 unknown, 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:22.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: cluster 2021-01-27T09:31:21.101460+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:22.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: audit 2021-01-27T09:31:21.110785+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:22.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: cluster 2021-01-27T09:31:21.111074+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T09:31:22.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: audit 2021-01-27T09:31:21.113197+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: audit 2021-01-27T09:31:21.113688+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:22.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: audit 2021-01-27T09:31:21.120586+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:22 smithi103 bash[13570]: audit 2021-01-27T09:31:21.120930+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:22.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: cluster 2021-01-27T09:31:20.427722+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v577: 244 pgs: 5 creating+peering, 11 unknown, 228 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:22.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: cluster 2021-01-27T09:31:21.101460+0000 mon.a (mon.0) 1608 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:22.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: audit 2021-01-27T09:31:21.110785+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-27"}]': finished 2021-01-27T09:31:22.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: cluster 2021-01-27T09:31:21.111074+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T09:31:22.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: audit 2021-01-27T09:31:21.113197+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: audit 2021-01-27T09:31:21.113688+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:22.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: audit 2021-01-27T09:31:21.120586+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:22.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:22 smithi047 bash[9721]: audit 2021-01-27T09:31:21.120930+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.127897+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:23.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.127975+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:23.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: cluster 2021-01-27T09:31:22.128065+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T09:31:23.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.128744+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.129040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.129172+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[13570]: audit 2021-01-27T09:31:22.129882+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.127897+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:23.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.127975+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:23.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: cluster 2021-01-27T09:31:22.128065+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T09:31:23.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.128744+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.129040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.129172+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:23 smithi103 bash[9772]: audit 2021-01-27T09:31:22.129882+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.127897+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:23.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.127975+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:23.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: cluster 2021-01-27T09:31:22.128065+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T09:31:23.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.128744+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.103:0/2558304926' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.129040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.103:0/2830510790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:23.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.129172+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]: dispatch 2021-01-27T09:31:23.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:23 smithi047 bash[9721]: audit 2021-01-27T09:31:22.129882+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]: dispatch 2021-01-27T09:31:24.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: cluster 2021-01-27T09:31:22.428511+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v580: 196 pgs: 196 active+clean; 26 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:24.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.137459+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.137615+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: cluster 2021-01-27T09:31:23.137734+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T09:31:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.140112+0000 mon.b (mon.2) 149 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.152991+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.170056+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.170931+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.171618+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.171896+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.172298+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.172306+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.172619+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.173152+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:24 smithi047 bash[9721]: audit 2021-01-27T09:31:23.173452+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[10018]: debug 2021-01-27T09:31:24.232+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:24.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: cluster 2021-01-27T09:31:22.428511+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v580: 196 pgs: 196 active+clean; 26 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:24.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.137459+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:24.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.137615+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:24.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: cluster 2021-01-27T09:31:23.137734+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T09:31:24.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.140112+0000 mon.b (mon.2) 149 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.152991+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.170056+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.170931+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.171618+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.171896+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.172298+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.172306+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.172619+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.173152+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[13570]: audit 2021-01-27T09:31:23.173452+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: cluster 2021-01-27T09:31:22.428511+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v580: 196 pgs: 196 active+clean; 26 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T09:31:24.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.137459+0000 mon.a (mon.0) 1618 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-43"}]': finished 2021-01-27T09:31:24.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.137615+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-35"}]': finished 2021-01-27T09:31:24.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: cluster 2021-01-27T09:31:23.137734+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T09:31:24.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.140112+0000 mon.b (mon.2) 149 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.152991+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:24.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.170056+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.170931+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.171618+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.171896+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.172298+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.172306+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.172619+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.173152+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:24 smithi103 bash[9772]: audit 2021-01-27T09:31:23.173452+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:26.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.143654+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:26.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.144119+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.144403+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: cluster 2021-01-27T09:31:24.144596+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T09:31:26.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.145538+0000 mon.b (mon.2) 150 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.145968+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.148638+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.149636+0000 mon.a (mon.0) 1633 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:26.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.150728+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:25 smithi047 bash[9721]: audit 2021-01-27T09:31:24.236677+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:26.401 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.143654+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:26.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.144119+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.402 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.144403+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: cluster 2021-01-27T09:31:24.144596+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T09:31:26.403 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.145538+0000 mon.b (mon.2) 150 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.145968+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.404 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.148638+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.149636+0000 mon.a (mon.0) 1633 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:26.405 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.150728+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.406 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[9772]: audit 2021-01-27T09:31:24.236677+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:26.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.143654+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:26.407 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.144119+0000 mon.a (mon.0) 1629 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.408 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.144403+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:26.408 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: cluster 2021-01-27T09:31:24.144596+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T09:31:26.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.145538+0000 mon.b (mon.2) 150 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.145968+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.409 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.148638+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:26.410 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.149636+0000 mon.a (mon.0) 1633 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:26.410 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.150728+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:26.411 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:25 smithi103 bash[13570]: audit 2021-01-27T09:31:24.236677+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:27.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: cluster 2021-01-27T09:31:24.429555+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v583: 228 pgs: 14 creating+peering, 14 unknown, 200 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:27.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:25.145120+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:27.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:25.145822+0000 mon.b (mon.2) 151 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: cluster 2021-01-27T09:31:25.962611+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T09:31:27.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:25.964479+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:26.074658+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:27.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:26.074889+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:27.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:26.075120+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:27.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: cluster 2021-01-27T09:31:26.075299+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T09:31:27.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:26.076628+0000 mon.b (mon.2) 152 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:27.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:26 smithi047 bash[9721]: audit 2021-01-27T09:31:26.086236+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:27.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: cluster 2021-01-27T09:31:24.429555+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v583: 228 pgs: 14 creating+peering, 14 unknown, 200 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:27.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:25.145120+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:27.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:25.145822+0000 mon.b (mon.2) 151 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: cluster 2021-01-27T09:31:25.962611+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T09:31:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:25.964479+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:26.074658+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:26.074889+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:27.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:26.075120+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:27.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: cluster 2021-01-27T09:31:26.075299+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T09:31:27.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:26.076628+0000 mon.b (mon.2) 152 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:27.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[13570]: audit 2021-01-27T09:31:26.086236+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:27.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: cluster 2021-01-27T09:31:24.429555+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v583: 228 pgs: 14 creating+peering, 14 unknown, 200 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:27.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:25.145120+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:27.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:25.145822+0000 mon.b (mon.2) 151 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: cluster 2021-01-27T09:31:25.962611+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T09:31:27.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:25.964479+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:27.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:26.074658+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:27.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:26.074889+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:27.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:26.075120+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:27.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: cluster 2021-01-27T09:31:26.075299+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T09:31:27.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:26.076628+0000 mon.b (mon.2) 152 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:27.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:26 smithi103 bash[9772]: audit 2021-01-27T09:31:26.086236+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]: dispatch 2021-01-27T09:31:28.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: cluster 2021-01-27T09:31:26.430682+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v586: 244 pgs: 15 creating+peering, 19 unknown, 210 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:28.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: cluster 2021-01-27T09:31:27.068759+0000 mon.a (mon.0) 1643 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:28.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: audit 2021-01-27T09:31:27.081091+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]': finished 2021-01-27T09:31:28.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: cluster 2021-01-27T09:31:27.081482+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T09:31:28.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: audit 2021-01-27T09:31:27.264052+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:28.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:27 smithi047 bash[9721]: audit 2021-01-27T09:31:27.265722+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: cluster 2021-01-27T09:31:26.430682+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v586: 244 pgs: 15 creating+peering, 19 unknown, 210 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: cluster 2021-01-27T09:31:27.068759+0000 mon.a (mon.0) 1643 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: audit 2021-01-27T09:31:27.081091+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]': finished 2021-01-27T09:31:28.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: cluster 2021-01-27T09:31:27.081482+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T09:31:28.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: audit 2021-01-27T09:31:27.264052+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:28.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[9772]: audit 2021-01-27T09:31:27.265722+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:28.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: cluster 2021-01-27T09:31:26.430682+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v586: 244 pgs: 15 creating+peering, 19 unknown, 210 active+clean; 26 KiB data, 311 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:28.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: cluster 2021-01-27T09:31:27.068759+0000 mon.a (mon.0) 1643 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:28.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: audit 2021-01-27T09:31:27.081091+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-29", "mode": "writeback"}]': finished 2021-01-27T09:31:28.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: cluster 2021-01-27T09:31:27.081482+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T09:31:28.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: audit 2021-01-27T09:31:27.264052+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:28.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:27 smithi103 bash[13570]: audit 2021-01-27T09:31:27.265722+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:29.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.094727+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:29.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: cluster 2021-01-27T09:31:28.094856+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T09:31:29.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.096581+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:29.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.097119+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.097719+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.097853+0000 mon.b (mon.2) 154 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:29.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[13570]: audit 2021-01-27T09:31:28.099168+0000 mon.a (mon.0) 1651 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:29.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.094727+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:29.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: cluster 2021-01-27T09:31:28.094856+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T09:31:29.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.096581+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:29.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.097119+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.097719+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.097853+0000 mon.b (mon.2) 154 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:29.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:29 smithi103 bash[9772]: audit 2021-01-27T09:31:28.099168+0000 mon.a (mon.0) 1651 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:29.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.094727+0000 mon.a (mon.0) 1647 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:29.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: cluster 2021-01-27T09:31:28.094856+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T09:31:29.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.096581+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:29.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.097119+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.097719+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.097853+0000 mon.b (mon.2) 154 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:29.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:29 smithi047 bash[9721]: audit 2021-01-27T09:31:28.099168+0000 mon.a (mon.0) 1651 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]: dispatch 2021-01-27T09:31:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: cluster 2021-01-27T09:31:28.432195+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v589: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T09:31:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: cluster 2021-01-27T09:31:29.090420+0000 mon.a (mon.0) 1652 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.106381+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:30.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.106553+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:30.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.106700+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:30.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: cluster 2021-01-27T09:31:29.106870+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T09:31:30.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.107814+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:30.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.108228+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:30.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[13570]: audit 2021-01-27T09:31:29.108833+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:30.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: cluster 2021-01-27T09:31:28.432195+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v589: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T09:31:30.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: cluster 2021-01-27T09:31:29.090420+0000 mon.a (mon.0) 1652 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:30.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.106381+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:30.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.106553+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:30.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.106700+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:30.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: cluster 2021-01-27T09:31:29.106870+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T09:31:30.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.107814+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:30.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.108228+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:30.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:30 smithi103 bash[9772]: audit 2021-01-27T09:31:29.108833+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:30.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: cluster 2021-01-27T09:31:28.432195+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v589: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T09:31:30.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: cluster 2021-01-27T09:31:29.090420+0000 mon.a (mon.0) 1652 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:30.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.106381+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:30.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.106553+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:30.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.106700+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-29"}]': finished 2021-01-27T09:31:30.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: cluster 2021-01-27T09:31:29.106870+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T09:31:30.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.107814+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.103:0/2219127664' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:30.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.108228+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]: dispatch 2021-01-27T09:31:30.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:30 smithi047 bash[9721]: audit 2021-01-27T09:31:29.108833+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]: dispatch 2021-01-27T09:31:31.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.110466+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:31.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.110738+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:31.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: cluster 2021-01-27T09:31:30.110928+0000 mon.a (mon.0) 1661 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T09:31:31.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.140181+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.145790+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.557447+0000 mon.a (mon.0) 1662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.558334+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.560347+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.561268+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.561288+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.562454+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.562579+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.563202+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.563579+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[9772]: audit 2021-01-27T09:31:30.565652+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.110466+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:31.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.110738+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:31.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: cluster 2021-01-27T09:31:30.110928+0000 mon.a (mon.0) 1661 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T09:31:31.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.140181+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.145790+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.557447+0000 mon.a (mon.0) 1662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.558334+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.560347+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.561268+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.561288+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.562454+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.562579+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.563202+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.563579+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:31 smithi103 bash[13570]: audit 2021-01-27T09:31:30.565652+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.110466+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.103:0/3099658769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-44"}]': finished 2021-01-27T09:31:31.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.110738+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-36"}]': finished 2021-01-27T09:31:31.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: cluster 2021-01-27T09:31:30.110928+0000 mon.a (mon.0) 1661 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T09:31:31.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.140181+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.145790+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.557447+0000 mon.a (mon.0) 1662 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.558334+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.560347+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.561268+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.561288+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:31.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.562454+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.562579+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:31.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.563202+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.563579+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:31.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:31 smithi047 bash[9721]: audit 2021-01-27T09:31:30.565652+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:33.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: cluster 2021-01-27T09:31:30.432981+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v592: 196 pgs: 196 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.134447+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.134589+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: cluster 2021-01-27T09:31:31.134730+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T09:31:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.138078+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.139210+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.139374+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:33.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.140373+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.141472+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:32 smithi047 bash[9721]: audit 2021-01-27T09:31:31.142423+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:33.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: cluster 2021-01-27T09:31:30.432981+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v592: 196 pgs: 196 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:33.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.134447+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.134589+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: cluster 2021-01-27T09:31:31.134730+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T09:31:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.138078+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.139210+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.139374+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:33.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.140373+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.141472+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.399 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[9772]: audit 2021-01-27T09:31:31.142423+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:33.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: cluster 2021-01-27T09:31:30.432981+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v592: 196 pgs: 196 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:33.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.134447+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.400 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.134589+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:33.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: cluster 2021-01-27T09:31:31.134730+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T09:31:33.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.138078+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.139210+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:33.413 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.139374+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:33.413 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.140373+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.413 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.141472+0000 mon.a (mon.0) 1672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:33.413 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:32 smithi103 bash[13570]: audit 2021-01-27T09:31:31.142423+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:34.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: cluster 2021-01-27T09:31:32.433562+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v595: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T09:31:34.244 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:32.974212+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:34.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: cluster 2021-01-27T09:31:32.975091+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T09:31:34.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:32.976609+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:32.986234+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:33.147818+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:34.245 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:33.148051+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:34.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:33.148131+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:34.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: cluster 2021-01-27T09:31:33.148203+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T09:31:34.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:33.150774+0000 mon.b (mon.2) 157 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[9772]: audit 2021-01-27T09:31:33.155997+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: cluster 2021-01-27T09:31:32.433562+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v595: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T09:31:34.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:32.974212+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:34.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: cluster 2021-01-27T09:31:32.975091+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T09:31:34.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:32.976609+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:32.986234+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:33.147818+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:34.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:33.148051+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:34.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:33.148131+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:34.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: cluster 2021-01-27T09:31:33.148203+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T09:31:34.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:33.150774+0000 mon.b (mon.2) 157 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:33 smithi103 bash[13570]: audit 2021-01-27T09:31:33.155997+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.249 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: cluster 2021-01-27T09:31:32.433562+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v595: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T09:31:34.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:32.974212+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:34.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: cluster 2021-01-27T09:31:32.975091+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T09:31:34.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:32.976609+0000 mon.b (mon.2) 156 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.250 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:32.986234+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:34.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:33.147818+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:34.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:33.148051+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:34.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:33.148131+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:34.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: cluster 2021-01-27T09:31:33.148203+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T09:31:34.251 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:33.150774+0000 mon.b (mon.2) 157 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.252 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:33 smithi047 bash[9721]: audit 2021-01-27T09:31:33.155997+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:34.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:34.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:34 smithi103 bash[10018]: debug 2021-01-27T09:31:34.240+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:35.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:35 smithi047 bash[9721]: audit 2021-01-27T09:31:34.157652+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:35 smithi047 bash[9721]: cluster 2021-01-27T09:31:34.158247+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T09:31:35.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:35 smithi047 bash[9721]: audit 2021-01-27T09:31:34.158489+0000 mon.b (mon.2) 158 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:35 smithi047 bash[9721]: audit 2021-01-27T09:31:34.159792+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:35 smithi047 bash[9721]: audit 2021-01-27T09:31:34.244688+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:35.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[9772]: audit 2021-01-27T09:31:34.157652+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:35.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[9772]: cluster 2021-01-27T09:31:34.158247+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T09:31:35.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[9772]: audit 2021-01-27T09:31:34.158489+0000 mon.b (mon.2) 158 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[9772]: audit 2021-01-27T09:31:34.159792+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[9772]: audit 2021-01-27T09:31:34.244688+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:35.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[13570]: audit 2021-01-27T09:31:34.157652+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:35.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[13570]: cluster 2021-01-27T09:31:34.158247+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T09:31:35.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[13570]: audit 2021-01-27T09:31:34.158489+0000 mon.b (mon.2) 158 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[13570]: audit 2021-01-27T09:31:34.159792+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]: dispatch 2021-01-27T09:31:35.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:35 smithi103 bash[13570]: audit 2021-01-27T09:31:34.244688+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:36.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: cluster 2021-01-27T09:31:34.434668+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v598: 244 pgs: 9 creating+peering, 16 unknown, 219 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:36.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: cluster 2021-01-27T09:31:35.146415+0000 mon.a (mon.0) 1685 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:36.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.155212+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]': finished 2021-01-27T09:31:36.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: cluster 2021-01-27T09:31:35.155684+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T09:31:36.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.157896+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.158699+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.158979+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.167334+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.442694+0000 mon.b (mon.2) 159 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:35.444362+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:36.157549+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:36.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:36.157740+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:36.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: audit 2021-01-27T09:31:36.157895+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:36.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:36 smithi047 bash[9721]: cluster 2021-01-27T09:31:36.158040+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T09:31:36.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: cluster 2021-01-27T09:31:34.434668+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v598: 244 pgs: 9 creating+peering, 16 unknown, 219 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:36.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: cluster 2021-01-27T09:31:35.146415+0000 mon.a (mon.0) 1685 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:36.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.155212+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]': finished 2021-01-27T09:31:36.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: cluster 2021-01-27T09:31:35.155684+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T09:31:36.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.157896+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.158699+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.158979+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.167334+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.442694+0000 mon.b (mon.2) 159 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:35.444362+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:36.157549+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:36.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:36.157740+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:36.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: audit 2021-01-27T09:31:36.157895+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:36.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[9772]: cluster 2021-01-27T09:31:36.158040+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T09:31:36.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: cluster 2021-01-27T09:31:34.434668+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v598: 244 pgs: 9 creating+peering, 16 unknown, 219 active+clean; 26 KiB data, 319 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:36.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: cluster 2021-01-27T09:31:35.146415+0000 mon.a (mon.0) 1685 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:36.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.155212+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-31", "mode": "writeback"}]': finished 2021-01-27T09:31:36.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: cluster 2021-01-27T09:31:35.155684+0000 mon.a (mon.0) 1687 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T09:31:36.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.157896+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.158699+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:36.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.158979+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.167334+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:36.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.442694+0000 mon.b (mon.2) 159 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:35.444362+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:36.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:36.157549+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:36.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:36.157740+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:36.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: audit 2021-01-27T09:31:36.157895+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:36.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:36 smithi103 bash[13570]: cluster 2021-01-27T09:31:36.158040+0000 mon.a (mon.0) 1694 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T09:31:37.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.160942+0000 mon.b (mon.2) 160 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.161795+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.162192+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.162450+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.162905+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: audit 2021-01-27T09:31:36.163128+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:37 smithi047 bash[9721]: cluster 2021-01-27T09:31:37.153370+0000 mon.a (mon.0) 1698 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:37.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.160942+0000 mon.b (mon.2) 160 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.161795+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.162192+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.162450+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.162905+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: audit 2021-01-27T09:31:36.163128+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[9772]: cluster 2021-01-27T09:31:37.153370+0000 mon.a (mon.0) 1698 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:37.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.160942+0000 mon.b (mon.2) 160 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.161795+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.103:0/3440628011' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.162192+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.103:0/3587548312' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.162450+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]: dispatch 2021-01-27T09:31:37.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.162905+0000 mon.a (mon.0) 1696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]: dispatch 2021-01-27T09:31:37.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: audit 2021-01-27T09:31:36.163128+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]: dispatch 2021-01-27T09:31:37.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:37 smithi103 bash[13570]: cluster 2021-01-27T09:31:37.153370+0000 mon.a (mon.0) 1698 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:38.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: cluster 2021-01-27T09:31:36.435751+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v601: 228 pgs: 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:38.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.164876+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:38.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.165704+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:38.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.165799+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:38.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: cluster 2021-01-27T09:31:37.165884+0000 mon.a (mon.0) 1702 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T09:31:38.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.191201+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.191731+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.193530+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.193929+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.194555+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.194686+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.195081+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.195383+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:38 smithi047 bash[9721]: audit 2021-01-27T09:31:37.195758+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: cluster 2021-01-27T09:31:36.435751+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v601: 228 pgs: 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:38.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.164876+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:38.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.165704+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:38.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.165799+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:38.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: cluster 2021-01-27T09:31:37.165884+0000 mon.a (mon.0) 1702 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T09:31:38.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.191201+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.191731+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.193530+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.193929+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.194555+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.194686+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.195081+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.195383+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[13570]: audit 2021-01-27T09:31:37.195758+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: cluster 2021-01-27T09:31:36.435751+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v601: 228 pgs: 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:38.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.164876+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-37"}]': finished 2021-01-27T09:31:38.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.165704+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-31"}]': finished 2021-01-27T09:31:38.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.165799+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-45"}]': finished 2021-01-27T09:31:38.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: cluster 2021-01-27T09:31:37.165884+0000 mon.a (mon.0) 1702 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T09:31:38.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.191201+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.191731+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.193530+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.193929+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:38.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.194555+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.194686+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.195081+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:38.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.195383+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:38.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:38 smithi103 bash[9772]: audit 2021-01-27T09:31:37.195758+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:39.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: audit 2021-01-27T09:31:38.189490+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: audit 2021-01-27T09:31:38.189601+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: cluster 2021-01-27T09:31:38.189714+0000 mon.a (mon.0) 1711 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T09:31:39.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: audit 2021-01-27T09:31:38.190283+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:39.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: audit 2021-01-27T09:31:38.190442+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:39.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:39 smithi047 bash[9721]: audit 2021-01-27T09:31:38.191002+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:39.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: audit 2021-01-27T09:31:38.189490+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: audit 2021-01-27T09:31:38.189601+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: cluster 2021-01-27T09:31:38.189714+0000 mon.a (mon.0) 1711 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T09:31:39.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: audit 2021-01-27T09:31:38.190283+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:39.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: audit 2021-01-27T09:31:38.190442+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:39.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[13570]: audit 2021-01-27T09:31:38.191002+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:39.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: audit 2021-01-27T09:31:38.189490+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: audit 2021-01-27T09:31:38.189601+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:39.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: cluster 2021-01-27T09:31:38.189714+0000 mon.a (mon.0) 1711 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T09:31:39.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: audit 2021-01-27T09:31:38.190283+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:39.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: audit 2021-01-27T09:31:38.190442+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:39.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:39 smithi103 bash[9772]: audit 2021-01-27T09:31:38.191002+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:40.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:40 smithi047 bash[9721]: cluster 2021-01-27T09:31:38.436955+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v604: 196 pgs: 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:40.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:40 smithi047 bash[9721]: cluster 2021-01-27T09:31:40.027219+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T09:31:40.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:40 smithi047 bash[9721]: audit 2021-01-27T09:31:40.028492+0000 mon.b (mon.2) 161 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:40.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:40 smithi047 bash[9721]: audit 2021-01-27T09:31:40.035155+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:40.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[13570]: cluster 2021-01-27T09:31:38.436955+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v604: 196 pgs: 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:40.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[13570]: cluster 2021-01-27T09:31:40.027219+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T09:31:40.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[13570]: audit 2021-01-27T09:31:40.028492+0000 mon.b (mon.2) 161 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:40.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[13570]: audit 2021-01-27T09:31:40.035155+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:40.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[9772]: cluster 2021-01-27T09:31:38.436955+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v604: 196 pgs: 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:40.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[9772]: cluster 2021-01-27T09:31:40.027219+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T09:31:40.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[9772]: audit 2021-01-27T09:31:40.028492+0000 mon.b (mon.2) 161 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:40.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:40 smithi103 bash[9772]: audit 2021-01-27T09:31:40.035155+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:41.551 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: audit 2021-01-27T09:31:40.215587+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:41.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: audit 2021-01-27T09:31:40.215776+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:41.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: audit 2021-01-27T09:31:40.216230+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:41.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: cluster 2021-01-27T09:31:40.216438+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T09:31:41.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: audit 2021-01-27T09:31:40.219080+0000 mon.b (mon.2) 162 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:41.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:41 smithi047 bash[9721]: audit 2021-01-27T09:31:40.230886+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:41.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: audit 2021-01-27T09:31:40.215587+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:41.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: audit 2021-01-27T09:31:40.215776+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:41.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: audit 2021-01-27T09:31:40.216230+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:41.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: cluster 2021-01-27T09:31:40.216438+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T09:31:41.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: audit 2021-01-27T09:31:40.219080+0000 mon.b (mon.2) 162 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:41.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[13570]: audit 2021-01-27T09:31:40.230886+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:41.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: audit 2021-01-27T09:31:40.215587+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:41.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: audit 2021-01-27T09:31:40.215776+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:41.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: audit 2021-01-27T09:31:40.216230+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:41.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: cluster 2021-01-27T09:31:40.216438+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T09:31:41.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: audit 2021-01-27T09:31:40.219080+0000 mon.b (mon.2) 162 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:41.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:41 smithi103 bash[9772]: audit 2021-01-27T09:31:40.230886+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: cluster 2021-01-27T09:31:40.437856+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v607: 244 pgs: 4 creating+peering, 44 unknown, 196 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:41.219384+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: cluster 2021-01-27T09:31:41.219781+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T09:31:42.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:41.221173+0000 mon.b (mon.2) 163 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:41.227100+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.224353+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: cluster 2021-01-27T09:31:42.224582+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T09:31:42.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.226052+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.226088+0000 mon.b (mon.2) 164 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.226594+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.227150+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:42 smithi047 bash[9721]: audit 2021-01-27T09:31:42.227444+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:42.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: cluster 2021-01-27T09:31:40.437856+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v607: 244 pgs: 4 creating+peering, 44 unknown, 196 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:42.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:41.219384+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:42.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: cluster 2021-01-27T09:31:41.219781+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T09:31:42.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:41.221173+0000 mon.b (mon.2) 163 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:41.227100+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.224353+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:42.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: cluster 2021-01-27T09:31:42.224582+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T09:31:42.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.226052+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:42.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.226088+0000 mon.b (mon.2) 164 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:42.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.226594+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.227150+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[9772]: audit 2021-01-27T09:31:42.227444+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:42.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: cluster 2021-01-27T09:31:40.437856+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v607: 244 pgs: 4 creating+peering, 44 unknown, 196 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:42.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:41.219384+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: cluster 2021-01-27T09:31:41.219781+0000 mon.a (mon.0) 1722 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T09:31:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:41.221173+0000 mon.b (mon.2) 163 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:41.227100+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.224353+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:42.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: cluster 2021-01-27T09:31:42.224582+0000 mon.a (mon.0) 1725 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T09:31:42.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.226052+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:42.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.226088+0000 mon.b (mon.2) 164 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:42.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.226594+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.227150+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:42.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:42 smithi103 bash[13570]: audit 2021-01-27T09:31:42.227444+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]: dispatch 2021-01-27T09:31:43.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: cluster 2021-01-27T09:31:43.215794+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:43.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.227662+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:43.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.227911+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:43.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.228137+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]': finished 2021-01-27T09:31:43.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: cluster 2021-01-27T09:31:43.228315+0000 mon.a (mon.0) 1733 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T09:31:43.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.229228+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:43.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.229303+0000 mon.a (mon.0) 1734 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:43.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:43 smithi047 bash[9721]: audit 2021-01-27T09:31:43.230155+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:43.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: cluster 2021-01-27T09:31:43.215794+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:43.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.227662+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:43.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.227911+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:43.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.228137+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]': finished 2021-01-27T09:31:43.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: cluster 2021-01-27T09:31:43.228315+0000 mon.a (mon.0) 1733 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T09:31:43.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.229228+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:43.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.229303+0000 mon.a (mon.0) 1734 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:43.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[13570]: audit 2021-01-27T09:31:43.230155+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:43.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: cluster 2021-01-27T09:31:43.215794+0000 mon.a (mon.0) 1729 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:43.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.227662+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:43.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.227911+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:43.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.228137+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-33", "mode": "writeback"}]': finished 2021-01-27T09:31:43.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: cluster 2021-01-27T09:31:43.228315+0000 mon.a (mon.0) 1733 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T09:31:43.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.229228+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.103:0/1398777325' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:43.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.229303+0000 mon.a (mon.0) 1734 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]: dispatch 2021-01-27T09:31:43.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:43 smithi103 bash[9772]: audit 2021-01-27T09:31:43.230155+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]: dispatch 2021-01-27T09:31:44.555 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:44.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:44 smithi047 bash[9721]: cluster 2021-01-27T09:31:42.438774+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v610: 228 pgs: 4 creating+peering, 25 unknown, 199 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:44.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:44 smithi047 bash[9721]: audit 2021-01-27T09:31:44.227450+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:44.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:44 smithi047 bash[9721]: audit 2021-01-27T09:31:44.227589+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:44.556 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:44 smithi047 bash[9721]: cluster 2021-01-27T09:31:44.227812+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T09:31:44.644 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[10018]: debug 2021-01-27T09:31:44.248+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:44.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[13570]: cluster 2021-01-27T09:31:42.438774+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v610: 228 pgs: 4 creating+peering, 25 unknown, 199 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:44.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[13570]: audit 2021-01-27T09:31:44.227450+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:44.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[13570]: audit 2021-01-27T09:31:44.227589+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:44.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[13570]: cluster 2021-01-27T09:31:44.227812+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T09:31:44.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[9772]: cluster 2021-01-27T09:31:42.438774+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v610: 228 pgs: 4 creating+peering, 25 unknown, 199 active+clean; 26 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T09:31:44.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[9772]: audit 2021-01-27T09:31:44.227450+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? 172.21.15.103:0/254875508' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-38"}]': finished 2021-01-27T09:31:44.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[9772]: audit 2021-01-27T09:31:44.227589+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-46"}]': finished 2021-01-27T09:31:44.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:44 smithi103 bash[9772]: cluster 2021-01-27T09:31:44.227812+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T09:31:45.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.252431+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:45.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.255563+0000 mon.b (mon.2) 165 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.256854+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.257191+0000 mon.b (mon.2) 166 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.693283+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.694020+0000 mon.b (mon.2) 167 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:44.695634+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:45.235133+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:45.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: cluster 2021-01-27T09:31:45.235372+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T09:31:45.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:45.243448+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:45.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:45.243641+0000 mon.b (mon.2) 168 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:45 smithi047 bash[9721]: audit 2021-01-27T09:31:45.245412+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.252431+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:45.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.255563+0000 mon.b (mon.2) 165 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.256854+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.257191+0000 mon.b (mon.2) 166 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.693283+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.694020+0000 mon.b (mon.2) 167 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:44.695634+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:45.235133+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:45.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: cluster 2021-01-27T09:31:45.235372+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T09:31:45.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:45.243448+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:45.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:45.243641+0000 mon.b (mon.2) 168 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[9772]: audit 2021-01-27T09:31:45.245412+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.252431+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:45.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.255563+0000 mon.b (mon.2) 165 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.256854+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.257191+0000 mon.b (mon.2) 166 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.693283+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.694020+0000 mon.b (mon.2) 167 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:44.695634+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:45.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:45.235133+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:45.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: cluster 2021-01-27T09:31:45.235372+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T09:31:45.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:45.243448+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:45.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:45.243641+0000 mon.b (mon.2) 168 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:45.654 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:45 smithi103 bash[13570]: audit 2021-01-27T09:31:45.245412+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:47.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:46 smithi047 bash[9721]: cluster 2021-01-27T09:31:44.439727+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v613: 228 pgs: 4 creating+peering, 2 unknown, 222 active+clean; 26 KiB data, 334 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:47.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:46 smithi047 bash[9721]: audit 2021-01-27T09:31:45.333448+0000 mon.b (mon.2) 169 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:47.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:46 smithi047 bash[9721]: audit 2021-01-27T09:31:45.334857+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:47.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[13570]: cluster 2021-01-27T09:31:44.439727+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v613: 228 pgs: 4 creating+peering, 2 unknown, 222 active+clean; 26 KiB data, 334 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:47.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[13570]: audit 2021-01-27T09:31:45.333448+0000 mon.b (mon.2) 169 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:47.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[13570]: audit 2021-01-27T09:31:45.334857+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:47.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[9772]: cluster 2021-01-27T09:31:44.439727+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v613: 228 pgs: 4 creating+peering, 2 unknown, 222 active+clean; 26 KiB data, 334 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:47.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[9772]: audit 2021-01-27T09:31:45.333448+0000 mon.b (mon.2) 169 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:47.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:46 smithi103 bash[9772]: audit 2021-01-27T09:31:45.334857+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:48.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:46.234480+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:48.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: cluster 2021-01-27T09:31:46.440867+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v616: 260 pgs: 3 creating+activating, 27 unknown, 230 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:31:48.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:46.661056+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:48.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: cluster 2021-01-27T09:31:46.661316+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T09:31:48.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:46.668428+0000 mon.b (mon.2) 170 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:46.684732+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:47.244668+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:48.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:47.244926+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:48.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: cluster 2021-01-27T09:31:47.245128+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T09:31:48.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:47.274952+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:47.276812+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:47 smithi047 bash[9721]: audit 2021-01-27T09:31:47.277402+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:48.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:46.234480+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: cluster 2021-01-27T09:31:46.440867+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v616: 260 pgs: 3 creating+activating, 27 unknown, 230 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:31:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:46.661056+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: cluster 2021-01-27T09:31:46.661316+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T09:31:48.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:46.668428+0000 mon.b (mon.2) 170 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:46.684732+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:47.244668+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:48.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:47.244926+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:48.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: cluster 2021-01-27T09:31:47.245128+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T09:31:48.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:47.274952+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:47.276812+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[9772]: audit 2021-01-27T09:31:47.277402+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:46.234480+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? 172.21.15.103:0/599803426' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: cluster 2021-01-27T09:31:46.440867+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v616: 260 pgs: 3 creating+activating, 27 unknown, 230 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T09:31:48.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:46.661056+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: cluster 2021-01-27T09:31:46.661316+0000 mon.a (mon.0) 1749 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T09:31:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:46.668428+0000 mon.b (mon.2) 170 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:46.684732+0000 mon.a (mon.0) 1750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:47.244668+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:48.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:47.244926+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:48.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: cluster 2021-01-27T09:31:47.245128+0000 mon.a (mon.0) 1753 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T09:31:48.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:47.274952+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:47.276812+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:48.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:47 smithi103 bash[13570]: audit 2021-01-27T09:31:47.277402+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:49 smithi047 bash[9721]: audit 2021-01-27T09:31:48.248695+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:49 smithi047 bash[9721]: cluster 2021-01-27T09:31:48.248805+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T09:31:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:49 smithi047 bash[9721]: audit 2021-01-27T09:31:48.250116+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:50.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:49 smithi047 bash[9721]: audit 2021-01-27T09:31:48.298871+0000 mon.b (mon.2) 171 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:50.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:49 smithi047 bash[9721]: audit 2021-01-27T09:31:48.300118+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[13570]: audit 2021-01-27T09:31:48.248695+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[13570]: cluster 2021-01-27T09:31:48.248805+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T09:31:50.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[13570]: audit 2021-01-27T09:31:48.250116+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[13570]: audit 2021-01-27T09:31:48.298871+0000 mon.b (mon.2) 171 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:50.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[13570]: audit 2021-01-27T09:31:48.300118+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:50.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[9772]: audit 2021-01-27T09:31:48.248695+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:50.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[9772]: cluster 2021-01-27T09:31:48.248805+0000 mon.a (mon.0) 1758 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T09:31:50.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[9772]: audit 2021-01-27T09:31:48.250116+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:50.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[9772]: audit 2021-01-27T09:31:48.298871+0000 mon.b (mon.2) 171 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:50.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:49 smithi103 bash[9772]: audit 2021-01-27T09:31:48.300118+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: cluster 2021-01-27T09:31:48.442332+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v619: 236 pgs: 1 creating+peering, 4 unknown, 231 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:31:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: cluster 2021-01-27T09:31:49.243326+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:49.671160+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: cluster 2021-01-27T09:31:49.671237+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T09:31:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:49.671819+0000 mon.b (mon.2) 172 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:49.673064+0000 mon.b (mon.2) 173 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:49.673750+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:49.681475+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: cluster 2021-01-27T09:31:50.245570+0000 mon.a (mon.0) 1766 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:50.255480+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:51.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:50.255708+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:50.255901+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: cluster 2021-01-27T09:31:50.256045+0000 mon.a (mon.0) 1770 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T09:31:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:50.257246+0000 mon.b (mon.2) 174 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:50 smithi047 bash[9721]: audit 2021-01-27T09:31:50.258912+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: cluster 2021-01-27T09:31:48.442332+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v619: 236 pgs: 1 creating+peering, 4 unknown, 231 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:31:51.285 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: cluster 2021-01-27T09:31:49.243326+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:51.285 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:49.671160+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:51.285 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: cluster 2021-01-27T09:31:49.671237+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T09:31:51.286 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:49.671819+0000 mon.b (mon.2) 172 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.286 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:49.673064+0000 mon.b (mon.2) 173 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.286 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:49.673750+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.286 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:49.681475+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.286 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: cluster 2021-01-27T09:31:50.245570+0000 mon.a (mon.0) 1766 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:51.287 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:50.255480+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:51.287 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:50.255708+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:51.287 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:50.255901+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:51.287 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: cluster 2021-01-27T09:31:50.256045+0000 mon.a (mon.0) 1770 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T09:31:51.288 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:50.257246+0000 mon.b (mon.2) 174 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.288 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[13570]: audit 2021-01-27T09:31:50.258912+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.288 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: cluster 2021-01-27T09:31:48.442332+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v619: 236 pgs: 1 creating+peering, 4 unknown, 231 active+clean; 27 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2021-01-27T09:31:51.288 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: cluster 2021-01-27T09:31:49.243326+0000 mon.a (mon.0) 1761 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:51.288 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:49.671160+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:51.289 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: cluster 2021-01-27T09:31:49.671237+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T09:31:51.289 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:49.671819+0000 mon.b (mon.2) 172 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.289 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:49.673064+0000 mon.b (mon.2) 173 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.289 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:49.673750+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]: dispatch 2021-01-27T09:31:51.290 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:49.681475+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.290 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: cluster 2021-01-27T09:31:50.245570+0000 mon.a (mon.0) 1766 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:51.290 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:50.255480+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:51.290 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:50.255708+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-33"}]': finished 2021-01-27T09:31:51.290 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:50.255901+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:51.291 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: cluster 2021-01-27T09:31:50.256045+0000 mon.a (mon.0) 1770 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T09:31:51.291 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:50.257246+0000 mon.b (mon.2) 174 : audit [INF] from='client.? 172.21.15.103:0/4028692230' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:51.291 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:50 smithi103 bash[9772]: audit 2021-01-27T09:31:50.258912+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]: dispatch 2021-01-27T09:31:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: cluster 2021-01-27T09:31:50.443152+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v622: 236 pgs: 8 unknown, 228 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-01-27T09:31:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.257061+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: cluster 2021-01-27T09:31:51.257441+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T09:31:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.288118+0000 mon.b (mon.2) 175 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.708834+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.709714+0000 mon.b (mon.2) 176 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.711854+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.712848+0000 mon.b (mon.2) 177 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:52.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:52 smithi047 bash[9721]: audit 2021-01-27T09:31:51.714452+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:52.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: cluster 2021-01-27T09:31:50.443152+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v622: 236 pgs: 8 unknown, 228 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-01-27T09:31:52.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.257061+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:52.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: cluster 2021-01-27T09:31:51.257441+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T09:31:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.288118+0000 mon.b (mon.2) 175 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.708834+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.709714+0000 mon.b (mon.2) 176 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.711854+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.712848+0000 mon.b (mon.2) 177 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:52.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[9772]: audit 2021-01-27T09:31:51.714452+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:52.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: cluster 2021-01-27T09:31:50.443152+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v622: 236 pgs: 8 unknown, 228 active+clean; 26 KiB data, 340 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-01-27T09:31:52.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.257061+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-39"}]': finished 2021-01-27T09:31:52.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: cluster 2021-01-27T09:31:51.257441+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T09:31:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.288118+0000 mon.b (mon.2) 175 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.708834+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.709714+0000 mon.b (mon.2) 176 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.711854+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:52.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.712848+0000 mon.b (mon.2) 177 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:52.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:52 smithi103 bash[13570]: audit 2021-01-27T09:31:51.714452+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:53.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.270637+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:53.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: cluster 2021-01-27T09:31:52.270753+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T09:31:53.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.272447+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:53.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.272905+0000 mon.b (mon.2) 178 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.273419+0000 mon.b (mon.2) 179 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:53.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.274287+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:53 smithi047 bash[9721]: audit 2021-01-27T09:31:52.275040+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:53.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.270637+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:53.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: cluster 2021-01-27T09:31:52.270753+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T09:31:53.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.272447+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:53.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.272905+0000 mon.b (mon.2) 178 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.273419+0000 mon.b (mon.2) 179 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:53.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.274287+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[9772]: audit 2021-01-27T09:31:52.275040+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:53.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.270637+0000 mon.a (mon.0) 1777 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32164-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:53.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: cluster 2021-01-27T09:31:52.270753+0000 mon.a (mon.0) 1778 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T09:31:53.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.272447+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:53.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.272905+0000 mon.b (mon.2) 178 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.273419+0000 mon.b (mon.2) 179 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:53.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.274287+0000 mon.a (mon.0) 1780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:53.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:53 smithi103 bash[13570]: audit 2021-01-27T09:31:52.275040+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:31:54.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:31:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: cluster 2021-01-27T09:31:52.444055+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 344 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T09:31:54.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: audit 2021-01-27T09:31:53.284936+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: audit 2021-01-27T09:31:53.705496+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: cluster 2021-01-27T09:31:53.706181+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T09:31:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: audit 2021-01-27T09:31:53.707982+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: audit 2021-01-27T09:31:53.709618+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:54.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:54 smithi047 bash[9721]: audit 2021-01-27T09:31:53.713233+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:54.644 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[10018]: debug 2021-01-27T09:31:54.256+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:31:54.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: cluster 2021-01-27T09:31:52.444055+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 344 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T09:31:54.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: audit 2021-01-27T09:31:53.284936+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: audit 2021-01-27T09:31:53.705496+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: cluster 2021-01-27T09:31:53.706181+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T09:31:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: audit 2021-01-27T09:31:53.707982+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: audit 2021-01-27T09:31:53.709618+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:54.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[13570]: audit 2021-01-27T09:31:53.713233+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:54.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: cluster 2021-01-27T09:31:52.444055+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v625: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 344 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T09:31:54.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: audit 2021-01-27T09:31:53.284936+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:54.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: audit 2021-01-27T09:31:53.705496+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:31:54.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: cluster 2021-01-27T09:31:53.706181+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T09:31:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: audit 2021-01-27T09:31:53.707982+0000 mon.b (mon.2) 180 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: audit 2021-01-27T09:31:53.709618+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]: dispatch 2021-01-27T09:31:54.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:54 smithi103 bash[9772]: audit 2021-01-27T09:31:53.713233+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:31:55.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.260729+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.289812+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.290060+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:55.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.290214+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: cluster 2021-01-27T09:31:54.290384+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T09:31:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.291469+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.298833+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.319927+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.321163+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:54.321628+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:55.291599+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:55.292036+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:55.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: cluster 2021-01-27T09:31:55.292204+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T09:31:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:55.294016+0000 mon.b (mon.2) 182 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:55.296162+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[9772]: audit 2021-01-27T09:31:55.296877+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:55.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.260729+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.289812+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.290060+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.290214+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: cluster 2021-01-27T09:31:54.290384+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T09:31:55.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.291469+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.298833+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.319927+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.321163+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.650 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:54.321628+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:55.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:55.291599+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:55.651 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:55.292036+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:55.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: cluster 2021-01-27T09:31:55.292204+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T09:31:55.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:55.294016+0000 mon.b (mon.2) 182 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:55.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:55.296162+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.652 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:55 smithi103 bash[13570]: audit 2021-01-27T09:31:55.296877+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:55.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.260729+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:31:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.289812+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32164-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.290060+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.103:0/1984638017' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-48"}]': finished 2021-01-27T09:31:55.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.290214+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:31:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: cluster 2021-01-27T09:31:54.290384+0000 mon.a (mon.0) 1790 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T09:31:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.291469+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.298833+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.319927+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.321163+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:54.321628+0000 mon.a (mon.0) 1794 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:31:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:55.291599+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:55.292036+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:31:55.806 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: cluster 2021-01-27T09:31:55.292204+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T09:31:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:55.294016+0000 mon.b (mon.2) 182 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:55.807 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:55.296162+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:55.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:55 smithi047 bash[9721]: audit 2021-01-27T09:31:55.296877+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]: dispatch 2021-01-27T09:31:56.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:56 smithi047 bash[9721]: cluster 2021-01-27T09:31:54.445204+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v628: 236 pgs: 7 creating+activating, 11 creating+peering, 16 unknown, 202 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:56.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:56 smithi047 bash[9721]: cluster 2021-01-27T09:31:56.076346+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:56.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:56 smithi047 bash[9721]: cluster 2021-01-27T09:31:56.078208+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:56.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[9772]: cluster 2021-01-27T09:31:54.445204+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v628: 236 pgs: 7 creating+activating, 11 creating+peering, 16 unknown, 202 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:56.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[9772]: cluster 2021-01-27T09:31:56.076346+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:56.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[9772]: cluster 2021-01-27T09:31:56.078208+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:56.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[13570]: cluster 2021-01-27T09:31:54.445204+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v628: 236 pgs: 7 creating+activating, 11 creating+peering, 16 unknown, 202 active+clean; 26 KiB data, 346 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:31:56.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[13570]: cluster 2021-01-27T09:31:56.076346+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T09:31:56.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:56 smithi103 bash[13570]: cluster 2021-01-27T09:31:56.078208+0000 mon.a (mon.0) 1801 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:31:57.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: cluster 2021-01-27T09:31:56.446304+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v631: 228 pgs: 7 creating+activating, 9 creating+peering, 212 active+clean; 26 KiB data, 330 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:57.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:56.522609+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]': finished 2021-01-27T09:31:57.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: cluster 2021-01-27T09:31:56.522892+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T09:31:57.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:56.524773+0000 mon.b (mon.2) 183 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:56.534329+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:56.609762+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:56.611176+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.094689+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:31:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.094821+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.094976+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: cluster 2021-01-27T09:31:57.095037+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T09:31:57.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.097214+0000 mon.b (mon.2) 185 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.097575+0000 mon.b (mon.2) 186 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.098510+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:57 smithi047 bash[9721]: audit 2021-01-27T09:31:57.099054+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:57.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: cluster 2021-01-27T09:31:56.446304+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v631: 228 pgs: 7 creating+activating, 9 creating+peering, 212 active+clean; 26 KiB data, 330 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:57.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:56.522609+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]': finished 2021-01-27T09:31:57.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: cluster 2021-01-27T09:31:56.522892+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T09:31:57.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:56.524773+0000 mon.b (mon.2) 183 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:56.534329+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:56.609762+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:56.611176+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.094689+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:31:57.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.094821+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:57.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.094976+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:57.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: cluster 2021-01-27T09:31:57.095037+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T09:31:57.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.097214+0000 mon.b (mon.2) 185 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.097575+0000 mon.b (mon.2) 186 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:57.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.098510+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[9772]: audit 2021-01-27T09:31:57.099054+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: cluster 2021-01-27T09:31:56.446304+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v631: 228 pgs: 7 creating+activating, 9 creating+peering, 212 active+clean; 26 KiB data, 330 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:31:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:56.522609+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-35", "mode": "writeback"}]': finished 2021-01-27T09:31:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: cluster 2021-01-27T09:31:56.522892+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T09:31:57.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:56.524773+0000 mon.b (mon.2) 183 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:56.534329+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:56.609762+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:56.611176+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:31:57.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.094689+0000 mon.a (mon.0) 1806 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:31:57.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.094821+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:57.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.094976+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:31:57.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: cluster 2021-01-27T09:31:57.095037+0000 mon.a (mon.0) 1809 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T09:31:57.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.097214+0000 mon.b (mon.2) 185 : audit [INF] from='client.? 172.21.15.103:0/1980344764' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.097575+0000 mon.b (mon.2) 186 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:57.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.098510+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]: dispatch 2021-01-27T09:31:57.901 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:57 smithi103 bash[13570]: audit 2021-01-27T09:31:57.099054+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]: dispatch 2021-01-27T09:31:58.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio_pp: [ OK undTrip 2021-01-27T09:31:58.110 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6974 ms) 2021-01-27T09:31:58.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2021-01-27T09:31:58.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7069 ms) 2021-01-27T09:31:58.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2021-01-27T09:31:58.111 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6969 ms) 2021-01-27T09:31:58.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2021-01-27T09:31:58.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7060 ms) 2021-01-27T09:31:58.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2021-01-27T09:31:58.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7071 ms) 2021-01-27T09:31:58.112 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2021-01-27T09:31:58.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7060 ms) 2021-01-27T09:31:58.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2021-01-27T09:31:58.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7038 ms) 2021-01-27T09:31:58.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2021-01-27T09:31:58.113 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6799 ms) 2021-01-27T09:31:58.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2021-01-27T09:31:58.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7058 ms) 2021-01-27T09:31:58.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2021-01-27T09:31:58.114 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6975 ms) 2021-01-27T09:31:58.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2021-01-27T09:31:58.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7041 ms) 2021-01-27T09:31:58.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2021-01-27T09:31:58.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7063 ms) 2021-01-27T09:31:58.115 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2021-01-27T09:31:58.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7039 ms) 2021-01-27T09:31:58.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2021-01-27T09:31:58.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6838 ms) 2021-01-27T09:31:58.116 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112065 ms total) 2021-01-27T09:31:58.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: 2021-01-27T09:31:58.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [----------] Global test environment tear-down 2021-01-27T09:31:58.117 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [==========] 40 tests from 2 test suites ran. (205152 ms total) 2021-01-27T09:31:58.118 INFO:tasks.workunit.client.0.smithi103.stdout: api_aio: [ PASSED ] 40 tests. 2021-01-27T09:31:58.119 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.119 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32215 2021-01-27T09:31:58.119 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32215 2021-01-27T09:31:58.119 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.119 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32631 2021-01-27T09:31:58.120 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32631 2021-01-27T09:31:58.120 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.120 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32575 2021-01-27T09:31:58.120 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32575 2021-01-27T09:31:58.120 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.121 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32175 2021-01-27T09:31:58.121 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32175 2021-01-27T09:31:58.121 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.121 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32371 2021-01-27T09:31:58.121 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32371 2021-01-27T09:31:58.122 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.122 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32471 2021-01-27T09:31:58.122 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32471 2021-01-27T09:31:58.122 INFO:tasks.workunit.client.0.smithi103.stderr:+ for t in "${!pids[@]}" 2021-01-27T09:31:58.122 INFO:tasks.workunit.client.0.smithi103.stderr:+ pid=32328 2021-01-27T09:31:58.123 INFO:tasks.workunit.client.0.smithi103.stderr:+ wait 32328 2021-01-27T09:31:58.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:58 smithi047 bash[9721]: cluster 2021-01-27T09:31:58.090447+0000 mon.a (mon.0) 1812 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:58.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:58 smithi047 bash[9721]: audit 2021-01-27T09:31:58.102618+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:58.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:58 smithi047 bash[9721]: audit 2021-01-27T09:31:58.102748+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:58.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:58 smithi047 bash[9721]: cluster 2021-01-27T09:31:58.103150+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T09:31:58.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[13570]: cluster 2021-01-27T09:31:58.090447+0000 mon.a (mon.0) 1812 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:58.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[13570]: audit 2021-01-27T09:31:58.102618+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:58.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[13570]: audit 2021-01-27T09:31:58.102748+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:58.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[13570]: cluster 2021-01-27T09:31:58.103150+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T09:31:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[9772]: cluster 2021-01-27T09:31:58.090447+0000 mon.a (mon.0) 1812 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:31:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[9772]: audit 2021-01-27T09:31:58.102618+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32164-40"}]': finished 2021-01-27T09:31:58.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[9772]: audit 2021-01-27T09:31:58.102748+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-35"}]': finished 2021-01-27T09:31:58.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:58 smithi103 bash[9772]: cluster 2021-01-27T09:31:58.103150+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T09:31:59.801 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:59 smithi047 bash[9721]: audit 2021-01-27T09:31:58.702068+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:59.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:59 smithi047 bash[9721]: audit 2021-01-27T09:31:58.733809+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:59.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:59 smithi047 bash[9721]: cluster 2021-01-27T09:31:59.101138+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T09:31:59.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:31:59 smithi047 bash[9721]: audit 2021-01-27T09:31:59.103531+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:59.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[13570]: audit 2021-01-27T09:31:58.702068+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:59.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[13570]: audit 2021-01-27T09:31:58.733809+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:59.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[13570]: cluster 2021-01-27T09:31:59.101138+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T09:31:59.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[13570]: audit 2021-01-27T09:31:59.103531+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:31:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[9772]: audit 2021-01-27T09:31:58.702068+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:31:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[9772]: audit 2021-01-27T09:31:58.733809+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:31:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[9772]: cluster 2021-01-27T09:31:59.101138+0000 mon.a (mon.0) 1818 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T09:31:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:31:59 smithi103 bash[9772]: audit 2021-01-27T09:31:59.103531+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:32:00.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: cluster 2021-01-27T09:31:58.447681+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v634: 236 pgs: 6 unknown, 230 active+clean; 26 KiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:00.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: audit 2021-01-27T09:32:00.107900+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:00.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: cluster 2021-01-27T09:32:00.108206+0000 mon.a (mon.0) 1821 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T09:32:00.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: audit 2021-01-27T09:32:00.110141+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:00.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: audit 2021-01-27T09:32:00.110568+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:32:00.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[13570]: audit 2021-01-27T09:32:00.111870+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:00.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: cluster 2021-01-27T09:31:58.447681+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v634: 236 pgs: 6 unknown, 230 active+clean; 26 KiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:00.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: audit 2021-01-27T09:32:00.107900+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: cluster 2021-01-27T09:32:00.108206+0000 mon.a (mon.0) 1821 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T09:32:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: audit 2021-01-27T09:32:00.110141+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: audit 2021-01-27T09:32:00.110568+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:32:00.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:00 smithi103 bash[9772]: audit 2021-01-27T09:32:00.111870+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: cluster 2021-01-27T09:31:58.447681+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v634: 236 pgs: 6 unknown, 230 active+clean; 26 KiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: audit 2021-01-27T09:32:00.107900+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: cluster 2021-01-27T09:32:00.108206+0000 mon.a (mon.0) 1821 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T09:32:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: audit 2021-01-27T09:32:00.110141+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: audit 2021-01-27T09:32:00.110568+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]: dispatch 2021-01-27T09:32:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:00 smithi047 bash[9721]: audit 2021-01-27T09:32:00.111870+0000 mon.a (mon.0) 1823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:02.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: cluster 2021-01-27T09:32:00.448565+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:02.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.117110+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.117309+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: cluster 2021-01-27T09:32:01.117883+0000 mon.a (mon.0) 1826 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T09:32:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.125110+0000 mon.b (mon.2) 188 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.127531+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.160074+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.160438+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.161011+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.161253+0000 mon.a (mon.0) 1829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.161713+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:02.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[9772]: audit 2021-01-27T09:32:01.161960+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: cluster 2021-01-27T09:32:00.448565+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:02.398 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.117110+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:02.399 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.117309+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:02.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: cluster 2021-01-27T09:32:01.117883+0000 mon.a (mon.0) 1826 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T09:32:02.401 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.125110+0000 mon.b (mon.2) 188 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.127531+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.160074+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.160438+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.402 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.161011+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.161253+0000 mon.a (mon.0) 1829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.161713+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:02.403 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:02 smithi103 bash[13570]: audit 2021-01-27T09:32:01.161960+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: cluster 2021-01-27T09:32:00.448565+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v637: 228 pgs: 32 unknown, 196 active+clean; 26 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.117110+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.103:0/628538684' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-49"}]': finished 2021-01-27T09:32:02.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.117309+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: cluster 2021-01-27T09:32:01.117883+0000 mon.a (mon.0) 1826 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T09:32:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.125110+0000 mon.b (mon.2) 188 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.127531+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:02.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.160074+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.160438+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.161011+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.161253+0000 mon.a (mon.0) 1829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:02.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.161713+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:02.555 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:02 smithi047 bash[9721]: audit 2021-01-27T09:32:01.161960+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:03.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.123031+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:03.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.123314+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:03.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: cluster 2021-01-27T09:32:02.123550+0000 mon.a (mon.0) 1833 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T09:32:03.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.124694+0000 mon.b (mon.2) 189 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:03.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.127147+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:03.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.134902+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:03.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[9772]: audit 2021-01-27T09:32:02.135972+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:03.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.123031+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:03.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.123314+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:03.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: cluster 2021-01-27T09:32:02.123550+0000 mon.a (mon.0) 1833 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T09:32:03.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.124694+0000 mon.b (mon.2) 189 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:03.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.127147+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:03.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.134902+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:03.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:03 smithi103 bash[13570]: audit 2021-01-27T09:32:02.135972+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:04.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.123031+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:04.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.123314+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:04.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: cluster 2021-01-27T09:32:02.123550+0000 mon.a (mon.0) 1833 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T09:32:04.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.124694+0000 mon.b (mon.2) 189 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:04.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.127147+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:04.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.134902+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:04.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:03 smithi047 bash[9721]: audit 2021-01-27T09:32:02.135972+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:04.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:04.578 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[10018]: debug 2021-01-27T09:32:04.268+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:04.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: cluster 2021-01-27T09:32:02.449438+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v640: 228 pgs: 27 unknown, 201 active+clean; 26 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:04.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:03.138584+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:04.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:03.143039+0000 mon.b (mon.2) 190 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:04.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: cluster 2021-01-27T09:32:03.571428+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T09:32:04.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:03.573727+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:04.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: cluster 2021-01-27T09:32:04.134024+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:32:04.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:04.143373+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:04.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:04.143564+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]': finished 2021-01-27T09:32:04.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: cluster 2021-01-27T09:32:04.143689+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T09:32:04.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[13570]: audit 2021-01-27T09:32:04.271900+0000 mgr.y (mgr.14138) 634 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:04.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: cluster 2021-01-27T09:32:02.449438+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v640: 228 pgs: 27 unknown, 201 active+clean; 26 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:04.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:03.138584+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:04.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:03.143039+0000 mon.b (mon.2) 190 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:04.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: cluster 2021-01-27T09:32:03.571428+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T09:32:04.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:03.573727+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:04.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: cluster 2021-01-27T09:32:04.134024+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:32:04.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:04.143373+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:04.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:04.143564+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]': finished 2021-01-27T09:32:04.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: cluster 2021-01-27T09:32:04.143689+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T09:32:04.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:04 smithi103 bash[9772]: audit 2021-01-27T09:32:04.271900+0000 mgr.y (mgr.14138) 634 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:05.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: cluster 2021-01-27T09:32:02.449438+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v640: 228 pgs: 27 unknown, 201 active+clean; 26 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:05.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:03.138584+0000 mon.a (mon.0) 1836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:05.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:03.143039+0000 mon.b (mon.2) 190 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:05.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: cluster 2021-01-27T09:32:03.571428+0000 mon.a (mon.0) 1837 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T09:32:05.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:03.573727+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]: dispatch 2021-01-27T09:32:05.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: cluster 2021-01-27T09:32:04.134024+0000 mon.a (mon.0) 1839 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:32:05.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:04.143373+0000 mon.a (mon.0) 1840 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:05.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:04.143564+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-37", "mode": "writeback"}]': finished 2021-01-27T09:32:05.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: cluster 2021-01-27T09:32:04.143689+0000 mon.a (mon.0) 1842 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T09:32:05.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:04 smithi047 bash[9721]: audit 2021-01-27T09:32:04.271900+0000 mgr.y (mgr.14138) 634 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:06.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:06 smithi103 bash[13570]: cluster 2021-01-27T09:32:04.450482+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v643: 236 pgs: 16 unknown, 220 active+clean; 26 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-01-27T09:32:06.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:06 smithi103 bash[13570]: cluster 2021-01-27T09:32:05.144553+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T09:32:06.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:06 smithi103 bash[9772]: cluster 2021-01-27T09:32:04.450482+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v643: 236 pgs: 16 unknown, 220 active+clean; 26 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-01-27T09:32:06.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:06 smithi103 bash[9772]: cluster 2021-01-27T09:32:05.144553+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T09:32:06.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:06 smithi047 bash[9721]: cluster 2021-01-27T09:32:04.450482+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v643: 236 pgs: 16 unknown, 220 active+clean; 26 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-01-27T09:32:06.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:06 smithi047 bash[9721]: cluster 2021-01-27T09:32:05.144553+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T09:32:07.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:07 smithi047 bash[9721]: cluster 2021-01-27T09:32:06.154846+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T09:32:07.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:07 smithi047 bash[9721]: audit 2021-01-27T09:32:06.158342+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:07.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:07 smithi047 bash[9721]: audit 2021-01-27T09:32:06.158700+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:07.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[13570]: cluster 2021-01-27T09:32:06.154846+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T09:32:07.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[13570]: audit 2021-01-27T09:32:06.158342+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:07.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[13570]: audit 2021-01-27T09:32:06.158700+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:07.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[9772]: cluster 2021-01-27T09:32:06.154846+0000 mon.a (mon.0) 1844 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T09:32:07.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[9772]: audit 2021-01-27T09:32:06.158342+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:07.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:07 smithi103 bash[9772]: audit 2021-01-27T09:32:06.158700+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:08 smithi047 bash[9721]: cluster 2021-01-27T09:32:06.451323+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 26 KiB data, 293 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:08.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:08 smithi047 bash[9721]: audit 2021-01-27T09:32:07.165395+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:08.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:08 smithi047 bash[9721]: cluster 2021-01-27T09:32:07.165467+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T09:32:08.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:08 smithi047 bash[9721]: audit 2021-01-27T09:32:07.166475+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:08 smithi047 bash[9721]: audit 2021-01-27T09:32:07.166984+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[13570]: cluster 2021-01-27T09:32:06.451323+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 26 KiB data, 293 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:08.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[13570]: audit 2021-01-27T09:32:07.165395+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:08.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[13570]: cluster 2021-01-27T09:32:07.165467+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T09:32:08.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[13570]: audit 2021-01-27T09:32:07.166475+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[13570]: audit 2021-01-27T09:32:07.166984+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[9772]: cluster 2021-01-27T09:32:06.451323+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v646: 228 pgs: 228 active+clean; 26 KiB data, 293 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:08.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[9772]: audit 2021-01-27T09:32:07.165395+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:08.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[9772]: cluster 2021-01-27T09:32:07.165467+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T09:32:08.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[9772]: audit 2021-01-27T09:32:07.166475+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.103:0/851941905' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:08.649 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:08 smithi103 bash[9772]: audit 2021-01-27T09:32:07.166984+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]: dispatch 2021-01-27T09:32:09.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:09 smithi047 bash[9721]: audit 2021-01-27T09:32:08.169059+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:09.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:09 smithi047 bash[9721]: cluster 2021-01-27T09:32:08.169236+0000 mon.a (mon.0) 1850 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T09:32:09.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:09 smithi047 bash[9721]: audit 2021-01-27T09:32:08.197560+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:09 smithi047 bash[9721]: audit 2021-01-27T09:32:08.198754+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:09 smithi047 bash[9721]: audit 2021-01-27T09:32:08.199234+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:09.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[13570]: audit 2021-01-27T09:32:08.169059+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:09.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[13570]: cluster 2021-01-27T09:32:08.169236+0000 mon.a (mon.0) 1850 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T09:32:09.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[13570]: audit 2021-01-27T09:32:08.197560+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[13570]: audit 2021-01-27T09:32:08.198754+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[13570]: audit 2021-01-27T09:32:08.199234+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[9772]: audit 2021-01-27T09:32:08.169059+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-50"}]': finished 2021-01-27T09:32:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[9772]: cluster 2021-01-27T09:32:08.169236+0000 mon.a (mon.0) 1850 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T09:32:09.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[9772]: audit 2021-01-27T09:32:08.197560+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[9772]: audit 2021-01-27T09:32:08.198754+0000 mon.a (mon.0) 1852 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:09.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:09 smithi103 bash[9772]: audit 2021-01-27T09:32:08.199234+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:10.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[13570]: cluster 2021-01-27T09:32:08.452113+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 3.8 MiB data, 298 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 24 op/s 2021-01-27T09:32:10.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[13570]: audit 2021-01-27T09:32:09.197311+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:10.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[13570]: cluster 2021-01-27T09:32:09.197455+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T09:32:10.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[13570]: audit 2021-01-27T09:32:09.199120+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:10.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[9772]: cluster 2021-01-27T09:32:08.452113+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 3.8 MiB data, 298 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 24 op/s 2021-01-27T09:32:10.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[9772]: audit 2021-01-27T09:32:09.197311+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:10.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[9772]: cluster 2021-01-27T09:32:09.197455+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T09:32:10.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:10 smithi103 bash[9772]: audit 2021-01-27T09:32:09.199120+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:11.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:10 smithi047 bash[9721]: cluster 2021-01-27T09:32:08.452113+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v649: 228 pgs: 228 active+clean; 3.8 MiB data, 298 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 24 op/s 2021-01-27T09:32:11.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:10 smithi047 bash[9721]: audit 2021-01-27T09:32:09.197311+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:11.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:10 smithi047 bash[9721]: cluster 2021-01-27T09:32:09.197455+0000 mon.a (mon.0) 1855 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T09:32:11.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:10 smithi047 bash[9721]: audit 2021-01-27T09:32:09.199120+0000 mon.a (mon.0) 1856 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:11.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[9772]: cluster 2021-01-27T09:32:10.452590+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 7.7 MiB data, 302 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 24 op/s 2021-01-27T09:32:11.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[9772]: cluster 2021-01-27T09:32:10.608859+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T09:32:11.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[9772]: audit 2021-01-27T09:32:11.205153+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:11.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[9772]: cluster 2021-01-27T09:32:11.205326+0000 mon.a (mon.0) 1859 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T09:32:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[13570]: cluster 2021-01-27T09:32:10.452590+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 7.7 MiB data, 302 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 24 op/s 2021-01-27T09:32:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[13570]: cluster 2021-01-27T09:32:10.608859+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T09:32:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[13570]: audit 2021-01-27T09:32:11.205153+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:11.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:11 smithi103 bash[13570]: cluster 2021-01-27T09:32:11.205326+0000 mon.a (mon.0) 1859 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T09:32:12.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:11 smithi047 bash[9721]: cluster 2021-01-27T09:32:10.452590+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v652: 228 pgs: 228 active+clean; 7.7 MiB data, 302 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 24 op/s 2021-01-27T09:32:12.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:11 smithi047 bash[9721]: cluster 2021-01-27T09:32:10.608859+0000 mon.a (mon.0) 1857 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T09:32:12.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:11 smithi047 bash[9721]: audit 2021-01-27T09:32:11.205153+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:12.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:11 smithi047 bash[9721]: cluster 2021-01-27T09:32:11.205326+0000 mon.a (mon.0) 1859 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T09:32:13.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:13 smithi047 bash[9721]: cluster 2021-01-27T09:32:12.205144+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T09:32:13.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:13 smithi103 bash[9772]: cluster 2021-01-27T09:32:12.205144+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T09:32:13.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:13 smithi103 bash[13570]: cluster 2021-01-27T09:32:12.205144+0000 mon.a (mon.0) 1860 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T09:32:14.552 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[9721]: cluster 2021-01-27T09:32:12.453350+0000 mgr.y (mgr.14138) 639 : cluster [DBG] pgmap v655: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-01-27T09:32:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[9721]: cluster 2021-01-27T09:32:13.214481+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T09:32:14.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[9721]: audit 2021-01-27T09:32:13.216551+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[9721]: audit 2021-01-27T09:32:13.327329+0000 mon.b (mon.2) 191 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:14.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:14 smithi047 bash[9721]: audit 2021-01-27T09:32:13.328633+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:14.644 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[10018]: debug 2021-01-27T09:32:14.279+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:14.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[9772]: cluster 2021-01-27T09:32:12.453350+0000 mgr.y (mgr.14138) 639 : cluster [DBG] pgmap v655: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-01-27T09:32:14.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[9772]: cluster 2021-01-27T09:32:13.214481+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T09:32:14.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[9772]: audit 2021-01-27T09:32:13.216551+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:14.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[9772]: audit 2021-01-27T09:32:13.327329+0000 mon.b (mon.2) 191 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:14.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[9772]: audit 2021-01-27T09:32:13.328633+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:14.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[13570]: cluster 2021-01-27T09:32:12.453350+0000 mgr.y (mgr.14138) 639 : cluster [DBG] pgmap v655: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-01-27T09:32:14.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[13570]: cluster 2021-01-27T09:32:13.214481+0000 mon.a (mon.0) 1861 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T09:32:14.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[13570]: audit 2021-01-27T09:32:13.216551+0000 mon.a (mon.0) 1862 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:14.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[13570]: audit 2021-01-27T09:32:13.327329+0000 mon.b (mon.2) 191 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:14.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:14 smithi103 bash[13570]: audit 2021-01-27T09:32:13.328633+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:15.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.217368+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:15.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.217558+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:32:15.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: cluster 2021-01-27T09:32:14.217750+0000 mon.a (mon.0) 1866 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T09:32:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.219857+0000 mon.b (mon.2) 192 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.220574+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.221199+0000 mon.a (mon.0) 1868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: audit 2021-01-27T09:32:14.280587+0000 mgr.y (mgr.14138) 640 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:15.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:15 smithi047 bash[9721]: cluster 2021-01-27T09:32:15.212267+0000 mon.a (mon.0) 1869 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:32:15.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.217368+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:15.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.217558+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:32:15.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: cluster 2021-01-27T09:32:14.217750+0000 mon.a (mon.0) 1866 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T09:32:15.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.219857+0000 mon.b (mon.2) 192 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.220574+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:15.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.221199+0000 mon.a (mon.0) 1868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: audit 2021-01-27T09:32:14.280587+0000 mgr.y (mgr.14138) 640 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:15.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[13570]: cluster 2021-01-27T09:32:15.212267+0000 mon.a (mon.0) 1869 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:32:15.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.217368+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:15.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.217558+0000 mon.a (mon.0) 1865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:32:15.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: cluster 2021-01-27T09:32:14.217750+0000 mon.a (mon.0) 1866 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T09:32:15.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.219857+0000 mon.b (mon.2) 192 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.220574+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]: dispatch 2021-01-27T09:32:15.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.221199+0000 mon.a (mon.0) 1868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]: dispatch 2021-01-27T09:32:15.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: audit 2021-01-27T09:32:14.280587+0000 mgr.y (mgr.14138) 640 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:15.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:15 smithi103 bash[9772]: cluster 2021-01-27T09:32:15.212267+0000 mon.a (mon.0) 1869 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:32:16.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: cluster 2021-01-27T09:32:14.454429+0000 mgr.y (mgr.14138) 641 : cluster [DBG] pgmap v658: 228 pgs: 228 active+clean; 3.8 MiB data, 310 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 27 op/s 2021-01-27T09:32:16.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: audit 2021-01-27T09:32:15.222988+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:16.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: audit 2021-01-27T09:32:15.223235+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: cluster 2021-01-27T09:32:15.223502+0000 mon.a (mon.0) 1872 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T09:32:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: audit 2021-01-27T09:32:15.253448+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: audit 2021-01-27T09:32:15.254413+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:16 smithi047 bash[9721]: audit 2021-01-27T09:32:15.254918+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:16.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: cluster 2021-01-27T09:32:14.454429+0000 mgr.y (mgr.14138) 641 : cluster [DBG] pgmap v658: 228 pgs: 228 active+clean; 3.8 MiB data, 310 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 27 op/s 2021-01-27T09:32:16.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: audit 2021-01-27T09:32:15.222988+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:16.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: audit 2021-01-27T09:32:15.223235+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:16.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: cluster 2021-01-27T09:32:15.223502+0000 mon.a (mon.0) 1872 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T09:32:16.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: audit 2021-01-27T09:32:15.253448+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: audit 2021-01-27T09:32:15.254413+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[13570]: audit 2021-01-27T09:32:15.254918+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:16.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: cluster 2021-01-27T09:32:14.454429+0000 mgr.y (mgr.14138) 641 : cluster [DBG] pgmap v658: 228 pgs: 228 active+clean; 3.8 MiB data, 310 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 27 op/s 2021-01-27T09:32:16.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: audit 2021-01-27T09:32:15.222988+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.103:0/2950703242' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-51"}]': finished 2021-01-27T09:32:16.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: audit 2021-01-27T09:32:15.223235+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-37"}]': finished 2021-01-27T09:32:16.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: cluster 2021-01-27T09:32:15.223502+0000 mon.a (mon.0) 1872 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T09:32:16.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: audit 2021-01-27T09:32:15.253448+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: audit 2021-01-27T09:32:15.254413+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:16.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:16 smithi103 bash[9772]: audit 2021-01-27T09:32:15.254918+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:17 smithi047 bash[9721]: audit 2021-01-27T09:32:16.248596+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:17 smithi047 bash[9721]: cluster 2021-01-27T09:32:16.248772+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T09:32:17.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:17 smithi047 bash[9721]: audit 2021-01-27T09:32:16.249455+0000 mon.a (mon.0) 1878 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:17.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[13570]: audit 2021-01-27T09:32:16.248596+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:17.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[13570]: cluster 2021-01-27T09:32:16.248772+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T09:32:17.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[13570]: audit 2021-01-27T09:32:16.249455+0000 mon.a (mon.0) 1878 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[9772]: audit 2021-01-27T09:32:16.248596+0000 mon.a (mon.0) 1876 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[9772]: cluster 2021-01-27T09:32:16.248772+0000 mon.a (mon.0) 1877 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T09:32:17.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:17 smithi103 bash[9772]: audit 2021-01-27T09:32:16.249455+0000 mon.a (mon.0) 1878 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:18.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:18 smithi047 bash[9721]: cluster 2021-01-27T09:32:16.455323+0000 mgr.y (mgr.14138) 642 : cluster [DBG] pgmap v661: 196 pgs: 196 active+clean; 3.8 MiB data, 303 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:18.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:18 smithi047 bash[9721]: cluster 2021-01-27T09:32:17.689274+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T09:32:18.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:18 smithi047 bash[9721]: audit 2021-01-27T09:32:17.690619+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:18.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:18 smithi047 bash[9721]: audit 2021-01-27T09:32:17.697245+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:18.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[13570]: cluster 2021-01-27T09:32:16.455323+0000 mgr.y (mgr.14138) 642 : cluster [DBG] pgmap v661: 196 pgs: 196 active+clean; 3.8 MiB data, 303 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:18.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[13570]: cluster 2021-01-27T09:32:17.689274+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T09:32:18.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[13570]: audit 2021-01-27T09:32:17.690619+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:18.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[13570]: audit 2021-01-27T09:32:17.697245+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[9772]: cluster 2021-01-27T09:32:16.455323+0000 mgr.y (mgr.14138) 642 : cluster [DBG] pgmap v661: 196 pgs: 196 active+clean; 3.8 MiB data, 303 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[9772]: cluster 2021-01-27T09:32:17.689274+0000 mon.a (mon.0) 1879 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T09:32:18.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[9772]: audit 2021-01-27T09:32:17.690619+0000 mon.b (mon.2) 193 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:18.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:18 smithi103 bash[9772]: audit 2021-01-27T09:32:17.697245+0000 mon.a (mon.0) 1880 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:19.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:19 smithi047 bash[9721]: audit 2021-01-27T09:32:18.273559+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:19.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:19 smithi047 bash[9721]: audit 2021-01-27T09:32:18.273964+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:19.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:19 smithi047 bash[9721]: cluster 2021-01-27T09:32:18.274189+0000 mon.a (mon.0) 1883 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T09:32:19.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:19 smithi047 bash[9721]: audit 2021-01-27T09:32:18.280068+0000 mon.b (mon.2) 194 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:19.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:19 smithi047 bash[9721]: audit 2021-01-27T09:32:18.281905+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:19.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[13570]: audit 2021-01-27T09:32:18.273559+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:19.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[13570]: audit 2021-01-27T09:32:18.273964+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:19.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[13570]: cluster 2021-01-27T09:32:18.274189+0000 mon.a (mon.0) 1883 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T09:32:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[13570]: audit 2021-01-27T09:32:18.280068+0000 mon.b (mon.2) 194 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:19.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[13570]: audit 2021-01-27T09:32:18.281905+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:19.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[9772]: audit 2021-01-27T09:32:18.273559+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:19.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[9772]: audit 2021-01-27T09:32:18.273964+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:19.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[9772]: cluster 2021-01-27T09:32:18.274189+0000 mon.a (mon.0) 1883 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T09:32:19.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[9772]: audit 2021-01-27T09:32:18.280068+0000 mon.b (mon.2) 194 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:19.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:19 smithi103 bash[9772]: audit 2021-01-27T09:32:18.281905+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:20.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:20 smithi047 bash[9721]: cluster 2021-01-27T09:32:18.456687+0000 mgr.y (mgr.14138) 643 : cluster [DBG] pgmap v664: 236 pgs: 12 creating+peering, 19 unknown, 205 active+clean; 3.8 MiB data, 300 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:20.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:20 smithi047 bash[9721]: audit 2021-01-27T09:32:19.288731+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:20.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:20 smithi047 bash[9721]: cluster 2021-01-27T09:32:19.288991+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T09:32:20.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:20 smithi047 bash[9721]: audit 2021-01-27T09:32:19.289847+0000 mon.b (mon.2) 195 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:20.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:20 smithi047 bash[9721]: audit 2021-01-27T09:32:19.291178+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:20.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[9772]: cluster 2021-01-27T09:32:18.456687+0000 mgr.y (mgr.14138) 643 : cluster [DBG] pgmap v664: 236 pgs: 12 creating+peering, 19 unknown, 205 active+clean; 3.8 MiB data, 300 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:20.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[9772]: audit 2021-01-27T09:32:19.288731+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:20.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[9772]: cluster 2021-01-27T09:32:19.288991+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T09:32:20.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[9772]: audit 2021-01-27T09:32:19.289847+0000 mon.b (mon.2) 195 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:20.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[9772]: audit 2021-01-27T09:32:19.291178+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:20.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[13570]: cluster 2021-01-27T09:32:18.456687+0000 mgr.y (mgr.14138) 643 : cluster [DBG] pgmap v664: 236 pgs: 12 creating+peering, 19 unknown, 205 active+clean; 3.8 MiB data, 300 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:20.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[13570]: audit 2021-01-27T09:32:19.288731+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:20.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[13570]: cluster 2021-01-27T09:32:19.288991+0000 mon.a (mon.0) 1886 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T09:32:20.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[13570]: audit 2021-01-27T09:32:19.289847+0000 mon.b (mon.2) 195 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:20.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:20 smithi103 bash[13570]: audit 2021-01-27T09:32:19.291178+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:32:21.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[9772]: audit 2021-01-27T09:32:20.301511+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:32:21.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[9772]: cluster 2021-01-27T09:32:20.301690+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T09:32:21.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[9772]: audit 2021-01-27T09:32:20.304293+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:21.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[9772]: audit 2021-01-27T09:32:20.304901+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:21.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[9772]: audit 2021-01-27T09:32:20.306755+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:21.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[13570]: audit 2021-01-27T09:32:20.301511+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:32:21.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[13570]: cluster 2021-01-27T09:32:20.301690+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T09:32:21.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[13570]: audit 2021-01-27T09:32:20.304293+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:21.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[13570]: audit 2021-01-27T09:32:20.304901+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:21.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:21 smithi103 bash[13570]: audit 2021-01-27T09:32:20.306755+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:21 smithi047 bash[9721]: audit 2021-01-27T09:32:20.301511+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:32:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:21 smithi047 bash[9721]: cluster 2021-01-27T09:32:20.301690+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T09:32:21.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:21 smithi047 bash[9721]: audit 2021-01-27T09:32:20.304293+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:21 smithi047 bash[9721]: audit 2021-01-27T09:32:20.304901+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:21.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:21 smithi047 bash[9721]: audit 2021-01-27T09:32:20.306755+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:22.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: cluster 2021-01-27T09:32:20.457552+0000 mgr.y (mgr.14138) 644 : cluster [DBG] pgmap v667: 228 pgs: 8 creating+peering, 7 unknown, 213 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:22.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:21.307356+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:21.307541+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:22.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: cluster 2021-01-27T09:32:21.307726+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T09:32:22.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:21.309611+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:22.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:21.312892+0000 mon.b (mon.2) 197 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:21.319323+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:22.310304+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: audit 2021-01-27T09:32:22.310495+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]': finished 2021-01-27T09:32:22.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[9772]: cluster 2021-01-27T09:32:22.310688+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T09:32:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: cluster 2021-01-27T09:32:20.457552+0000 mgr.y (mgr.14138) 644 : cluster [DBG] pgmap v667: 228 pgs: 8 creating+peering, 7 unknown, 213 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:21.307356+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:21.307541+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: cluster 2021-01-27T09:32:21.307726+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T09:32:22.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:21.309611+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:22.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:21.312892+0000 mon.b (mon.2) 197 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:21.319323+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:22.310304+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: audit 2021-01-27T09:32:22.310495+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]': finished 2021-01-27T09:32:22.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:22 smithi103 bash[13570]: cluster 2021-01-27T09:32:22.310688+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T09:32:22.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: cluster 2021-01-27T09:32:20.457552+0000 mgr.y (mgr.14138) 644 : cluster [DBG] pgmap v667: 228 pgs: 8 creating+peering, 7 unknown, 213 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:22.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:21.307356+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:21.307541+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: cluster 2021-01-27T09:32:21.307726+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T09:32:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:21.309611+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]: dispatch 2021-01-27T09:32:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:21.312892+0000 mon.b (mon.2) 197 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:21.319323+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-01-27T09:32:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:22.310304+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? 172.21.15.103:0/2946094975' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-52"}]': finished 2021-01-27T09:32:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: audit 2021-01-27T09:32:22.310495+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-39","var": "hit_set_type","val": "explicit_object"}]': finished 2021-01-27T09:32:22.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:22 smithi047 bash[9721]: cluster 2021-01-27T09:32:22.310688+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T09:32:23.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.337023+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.337399+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.338028+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.338380+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.338932+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:23.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[13570]: audit 2021-01-27T09:32:22.339245+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:23.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.337023+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.337399+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.338028+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.338380+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.647 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.338932+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:23.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:23 smithi103 bash[9772]: audit 2021-01-27T09:32:22.339245+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.337023+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.337399+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.338028+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.338380+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:23.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.338932+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:23.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:23 smithi047 bash[9721]: audit 2021-01-27T09:32:22.339245+0000 mon.a (mon.0) 1902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:24.551 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:24.644 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[10018]: debug 2021-01-27T09:32:24.287+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: cluster 2021-01-27T09:32:22.458473+0000 mgr.y (mgr.14138) 645 : cluster [DBG] pgmap v670: 228 pgs: 8 creating+peering, 220 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:25.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.331220+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: cluster 2021-01-27T09:32:23.331429+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T09:32:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.334389+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.341405+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.371659+0000 mon.b (mon.2) 198 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.372954+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.373203+0000 mon.b (mon.2) 199 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:23.374350+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:24 smithi047 bash[9721]: audit 2021-01-27T09:32:24.291850+0000 mgr.y (mgr.14138) 646 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:25.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: cluster 2021-01-27T09:32:22.458473+0000 mgr.y (mgr.14138) 645 : cluster [DBG] pgmap v670: 228 pgs: 8 creating+peering, 220 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:25.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.331220+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:25.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: cluster 2021-01-27T09:32:23.331429+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T09:32:25.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.334389+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.341405+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.371659+0000 mon.b (mon.2) 198 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.372954+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.373203+0000 mon.b (mon.2) 199 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:23.374350+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[9772]: audit 2021-01-27T09:32:24.291850+0000 mgr.y (mgr.14138) 646 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: cluster 2021-01-27T09:32:22.458473+0000 mgr.y (mgr.14138) 645 : cluster [DBG] pgmap v670: 228 pgs: 8 creating+peering, 220 active+clean; 3.8 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:25.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.331220+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:25.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: cluster 2021-01-27T09:32:23.331429+0000 mon.a (mon.0) 1904 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T09:32:25.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.334389+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.341405+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:25.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.371659+0000 mon.b (mon.2) 198 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.372954+0000 mon.a (mon.0) 1906 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:25.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.373203+0000 mon.b (mon.2) 199 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:23.374350+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]: dispatch 2021-01-27T09:32:25.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:24 smithi103 bash[13570]: audit 2021-01-27T09:32:24.291850+0000 mgr.y (mgr.14138) 646 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:25.353 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [==========] Running 71 tests from 4 test suites. 2021-01-27T09:32:25.354 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [----------] Global test environment set-up. 2021-01-27T09:32:25.354 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2021-01-27T09:32:25.354 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: seed 32354 2021-01-27T09:32:25.354 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2021-01-27T09:32:25.354 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (401 ms) 2021-01-27T09:32:25.355 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2021-01-27T09:32:25.355 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (14832 ms) 2021-01-27T09:32:25.355 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2021-01-27T09:32:25.355 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (3 ms) 2021-01-27T09:32:25.356 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (15236 ms total) 2021-01-27T09:32:25.356 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: 2021-01-27T09:32:25.356 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [----------] 42 tests from LibRadosTwoPoolsPP 2021-01-27T09:32:25.356 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2021-01-27T09:32:25.356 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7883 ms) 2021-01-27T09:32:25.357 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2021-01-27T09:32:25.357 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (9676 ms) 2021-01-27T09:32:25.357 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2021-01-27T09:32:25.357 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (10009 ms) 2021-01-27T09:32:25.358 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2021-01-27T09:32:25.358 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: my_snaps [4] 2021-01-27T09:32:25.358 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: my_snaps [5,4] 2021-01-27T09:32:25.358 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: my_snaps [6,5,4] 2021-01-27T09:32:25.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: my_snaps [7,6,5,4] 2021-01-27T09:32:25.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: promoting some heads 2021-01-27T09:32:25.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: promoting from clones for snap 7 2021-01-27T09:32:25.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: promoting from clones for snap 6 2021-01-27T09:32:25.359 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: promoting from clones for snap 5 2021-01-27T09:32:25.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: promoting from clones for snap 4 2021-01-27T09:32:25.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: waiting for scrubs... 2021-01-27T09:32:25.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: done waiting 2021-01-27T09:32:25.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (48515 ms) 2021-01-27T09:32:25.360 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2021-01-27T09:32:25.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10421 ms) 2021-01-27T09:32:25.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2021-01-27T09:32:25.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7572 ms) 2021-01-27T09:32:25.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2021-01-27T09:32:25.361 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8052 ms) 2021-01-27T09:32:25.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2021-01-27T09:32:25.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8092 ms) 2021-01-27T09:32:25.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2021-01-27T09:32:25.362 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10080 ms) 2021-01-27T09:32:25.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2021-01-27T09:32:25.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8813 ms) 2021-01-27T09:32:25.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2021-01-27T09:32:25.363 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10054 ms) 2021-01-27T09:32:25.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2021-01-27T09:32:25.364 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7986 ms) 2021-01-27T09:32:25.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2021-01-27T09:32:25.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8076 ms) 2021-01-27T09:32:25.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2021-01-27T09:32:25.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13072 ms) 2021-01-27T09:32:25.365 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2021-01-27T09:32:25.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7843 ms) 2021-01-27T09:32:25.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2021-01-27T09:32:25.366 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (17144 ms) 2021-01-27T09:32:25.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2021-01-27T09:32:25.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: hmm, no HitSet yet 2021-01-27T09:32:25.367 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: ok, hit_set contains 183:602f83fe:::foo:head 2021-01-27T09:32:26.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:25 smithi047 bash[9721]: cluster 2021-01-27T09:32:24.459412+0000 mgr.y (mgr.14138) 647 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:26.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:25 smithi047 bash[9721]: audit 2021-01-27T09:32:24.773670+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]': finished 2021-01-27T09:32:26.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:25 smithi047 bash[9721]: cluster 2021-01-27T09:32:24.773910+0000 mon.a (mon.0) 1909 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T09:32:26.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:25 smithi047 bash[9721]: audit 2021-01-27T09:32:25.351704+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:26.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:25 smithi047 bash[9721]: cluster 2021-01-27T09:32:25.351962+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T09:32:26.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[9772]: cluster 2021-01-27T09:32:24.459412+0000 mgr.y (mgr.14138) 647 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:26.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[9772]: audit 2021-01-27T09:32:24.773670+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]': finished 2021-01-27T09:32:26.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[9772]: cluster 2021-01-27T09:32:24.773910+0000 mon.a (mon.0) 1909 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T09:32:26.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[9772]: audit 2021-01-27T09:32:25.351704+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:26.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[9772]: cluster 2021-01-27T09:32:25.351962+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T09:32:26.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[13570]: cluster 2021-01-27T09:32:24.459412+0000 mgr.y (mgr.14138) 647 : cluster [DBG] pgmap v673: 228 pgs: 228 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:26.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[13570]: audit 2021-01-27T09:32:24.773670+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-39"}]': finished 2021-01-27T09:32:26.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[13570]: cluster 2021-01-27T09:32:24.773910+0000 mon.a (mon.0) 1909 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T09:32:26.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[13570]: audit 2021-01-27T09:32:25.351704+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:26.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:25 smithi103 bash[13570]: cluster 2021-01-27T09:32:25.351962+0000 mon.a (mon.0) 1911 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T09:32:27.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[9772]: cluster 2021-01-27T09:32:26.351309+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T09:32:27.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[9772]: audit 2021-01-27T09:32:26.356559+0000 mon.b (mon.2) 200 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[9772]: audit 2021-01-27T09:32:26.358359+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[9772]: cluster 2021-01-27T09:32:26.460508+0000 mgr.y (mgr.14138) 648 : cluster [DBG] pgmap v676: 236 pgs: 5 creating+peering, 35 unknown, 196 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:27.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[13570]: cluster 2021-01-27T09:32:26.351309+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T09:32:27.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[13570]: audit 2021-01-27T09:32:26.356559+0000 mon.b (mon.2) 200 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[13570]: audit 2021-01-27T09:32:26.358359+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:27 smithi103 bash[13570]: cluster 2021-01-27T09:32:26.460508+0000 mgr.y (mgr.14138) 648 : cluster [DBG] pgmap v676: 236 pgs: 5 creating+peering, 35 unknown, 196 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:27 smithi047 bash[9721]: cluster 2021-01-27T09:32:26.351309+0000 mon.a (mon.0) 1912 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T09:32:27.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:27 smithi047 bash[9721]: audit 2021-01-27T09:32:26.356559+0000 mon.b (mon.2) 200 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:27 smithi047 bash[9721]: audit 2021-01-27T09:32:26.358359+0000 mon.a (mon.0) 1913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:27.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:27 smithi047 bash[9721]: cluster 2021-01-27T09:32:26.460508+0000 mgr.y (mgr.14138) 648 : cluster [DBG] pgmap v676: 236 pgs: 5 creating+peering, 35 unknown, 196 active+clean; 3.8 MiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:28.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.356527+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:28.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: cluster 2021-01-27T09:32:27.357148+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T09:32:28.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.362930+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-6","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:28.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.363325+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:28.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.364090+0000 mon.b (mon.2) 202 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.373776+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[9772]: audit 2021-01-27T09:32:27.374181+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:28.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.356527+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:28.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: cluster 2021-01-27T09:32:27.357148+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T09:32:28.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.362930+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-6","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:28.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.363325+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:28.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.364090+0000 mon.b (mon.2) 202 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.373776+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:28 smithi103 bash[13570]: audit 2021-01-27T09:32:27.374181+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.356527+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: cluster 2021-01-27T09:32:27.357148+0000 mon.a (mon.0) 1915 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T09:32:28.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.362930+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-6","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.363325+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.364090+0000 mon.b (mon.2) 202 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.373776+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:28.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:28 smithi047 bash[9721]: audit 2021-01-27T09:32:27.374181+0000 mon.a (mon.0) 1917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.384371+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:29.644 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.384521+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: cluster 2021-01-27T09:32:28.384655+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T09:32:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.385370+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.385463+0000 mon.b (mon.2) 203 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.385884+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: audit 2021-01-27T09:32:28.386641+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[9772]: cluster 2021-01-27T09:32:28.461224+0000 mgr.y (mgr.14138) 649 : cluster [DBG] pgmap v679: 228 pgs: 5 creating+peering, 13 unknown, 210 active+clean; 3.8 MiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:29.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.384371+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:29.646 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.384521+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:29.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: cluster 2021-01-27T09:32:28.384655+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T09:32:29.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.385370+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.385463+0000 mon.b (mon.2) 203 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.385884+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.647 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: audit 2021-01-27T09:32:28.386641+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.648 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:29 smithi103 bash[13570]: cluster 2021-01-27T09:32:28.461224+0000 mgr.y (mgr.14138) 649 : cluster [DBG] pgmap v679: 228 pgs: 5 creating+peering, 13 unknown, 210 active+clean; 3.8 MiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:29.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.384371+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:29.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.384521+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:29.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: cluster 2021-01-27T09:32:28.384655+0000 mon.a (mon.0) 1920 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T09:32:29.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.385370+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.103:0/4035286540' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.385463+0000 mon.b (mon.2) 203 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.385884+0000 mon.a (mon.0) 1921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]: dispatch 2021-01-27T09:32:29.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: audit 2021-01-27T09:32:28.386641+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]: dispatch 2021-01-27T09:32:29.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:29 smithi047 bash[9721]: cluster 2021-01-27T09:32:28.461224+0000 mgr.y (mgr.14138) 649 : cluster [DBG] pgmap v679: 228 pgs: 5 creating+peering, 13 unknown, 210 active+clean; 3.8 MiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:30.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.396947+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:30.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.397039+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]': finished 2021-01-27T09:32:30.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: cluster 2021-01-27T09:32:29.397120+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T09:32:30.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.402179+0000 mon.b (mon.2) 204 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.403579+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.417421+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.417801+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.418812+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.419244+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.419910+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:30.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:30 smithi047 bash[9721]: audit 2021-01-27T09:32:29.420294+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:30.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.396947+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:30.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.397039+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]': finished 2021-01-27T09:32:30.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: cluster 2021-01-27T09:32:29.397120+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T09:32:30.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.402179+0000 mon.b (mon.2) 204 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.403579+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.417421+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.417801+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.418812+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.419244+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.419910+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:30.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[13570]: audit 2021-01-27T09:32:29.420294+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:30.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.396947+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-53"}]': finished 2021-01-27T09:32:30.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.397039+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_count","val": "8"}]': finished 2021-01-27T09:32:30.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: cluster 2021-01-27T09:32:29.397120+0000 mon.a (mon.0) 1925 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T09:32:30.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.402179+0000 mon.b (mon.2) 204 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.403579+0000 mon.a (mon.0) 1926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:32:30.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.417421+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.417801+0000 mon.a (mon.0) 1927 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.418812+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.419244+0000 mon.a (mon.0) 1928 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:30.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.419910+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:30.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:30 smithi103 bash[9772]: audit 2021-01-27T09:32:29.420294+0000 mon.a (mon.0) 1929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:32.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.402938+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:32.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.403188+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:32.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: cluster 2021-01-27T09:32:30.403391+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T09:32:32.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.405071+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.405707+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.411206+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: audit 2021-01-27T09:32:30.411495+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[9772]: cluster 2021-01-27T09:32:30.461935+0000 mgr.y (mgr.14138) 650 : cluster [DBG] pgmap v682: 228 pgs: 5 creating+peering, 223 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:32.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.402938+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:32.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.403188+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:32.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: cluster 2021-01-27T09:32:30.403391+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T09:32:32.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.405071+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.405707+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.411206+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: audit 2021-01-27T09:32:30.411495+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:31 smithi103 bash[13570]: cluster 2021-01-27T09:32:30.461935+0000 mgr.y (mgr.14138) 650 : cluster [DBG] pgmap v682: 228 pgs: 5 creating+peering, 223 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:32.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.402938+0000 mon.a (mon.0) 1930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:32:32.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.403188+0000 mon.a (mon.0) 1931 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:32.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: cluster 2021-01-27T09:32:30.403391+0000 mon.a (mon.0) 1932 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T09:32:32.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.405071+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.405707+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.411206+0000 mon.a (mon.0) 1933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-01-27T09:32:32.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: audit 2021-01-27T09:32:30.411495+0000 mon.a (mon.0) 1934 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:32.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:31 smithi047 bash[9721]: cluster 2021-01-27T09:32:30.461935+0000 mgr.y (mgr.14138) 650 : cluster [DBG] pgmap v682: 228 pgs: 5 creating+peering, 223 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:32.541 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9103 ms) 2021-01-27T09:32:32.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2021-01-27T09:32:32.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg_num = 32 2021-01-27T09:32:32.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 0 ls 1611739952,0 2021-01-27T09:32:32.542 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 1 ls 1611739952,0 2021-01-27T09:32:32.543 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 2 ls 1611739952,0 2021-01-27T09:32:32.543 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 3 ls 1611739952,0 2021-01-27T09:32:32.543 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 4 ls 1611739952,0 2021-01-27T09:32:32.543 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 5 ls 1611739952,0 2021-01-27T09:32:32.543 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 6 ls 1611739952,0 2021-01-27T09:32:32.544 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 7 ls 1611739952,0 2021-01-27T09:32:32.544 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 8 ls 1611739952,0 2021-01-27T09:32:32.544 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 9 ls 1611739952,0 2021-01-27T09:32:32.544 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 10 ls 1611739952,0 2021-01-27T09:32:32.544 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 11 ls 1611739952,0 2021-01-27T09:32:32.545 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 12 ls 1611739952,0 2021-01-27T09:32:32.545 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 13 ls 1611739952,0 2021-01-27T09:32:32.545 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 14 ls 1611739952,0 2021-01-27T09:32:32.545 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 15 ls 1611739952,0 2021-01-27T09:32:32.545 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 16 ls 1611739952,0 2021-01-27T09:32:32.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 17 ls 1611739952,0 2021-01-27T09:32:32.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 18 ls 1611739952,0 2021-01-27T09:32:32.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 19 ls 1611739952,0 2021-01-27T09:32:32.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 20 ls 1611739952,0 2021-01-27T09:32:32.546 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 21 ls 1611739952,0 2021-01-27T09:32:32.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 22 ls 1611739952,0 2021-01-27T09:32:32.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 23 ls 1611739952,0 2021-01-27T09:32:32.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 24 ls 1611739952,0 2021-01-27T09:32:32.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 25 ls 1611739952,0 2021-01-27T09:32:32.547 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 26 ls 1611739952,0 2021-01-27T09:32:32.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 27 ls 1611739952,0 2021-01-27T09:32:32.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 28 ls 1611739952,0 2021-01-27T09:32:32.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 29 ls 1611739952,0 2021-01-27T09:32:32.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 30 ls 1611739952,0 2021-01-27T09:32:32.548 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg 31 ls 1611739952,0 2021-01-27T09:32:32.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: pg_num = 32 2021-01-27T09:32:32.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6cac518f:::0:head 2021-01-27T09:32:32.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:02547ec2:::1:head 2021-01-27T09:32:32.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f905c69b:::2:head 2021-01-27T09:32:32.549 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:cfc208b3:::3:head 2021-01-27T09:32:32.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d83876eb:::4:head 2021-01-27T09:32:32.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b29083e3:::5:head 2021-01-27T09:32:32.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c4fdafeb:::6:head 2021-01-27T09:32:32.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:5c6b0b28:::7:head 2021-01-27T09:32:32.550 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:bd63b0f1:::8:head 2021-01-27T09:32:32.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:e960b815:::9:head 2021-01-27T09:32:32.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:52ea6a34:::10:head 2021-01-27T09:32:32.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:89d3ae78:::11:head 2021-01-27T09:32:32.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:de5d7c5f:::12:head 2021-01-27T09:32:32.551 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:566253c9:::13:head 2021-01-27T09:32:32.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:62a1935d:::14:head 2021-01-27T09:32:32.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:863748b0:::15:head 2021-01-27T09:32:32.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3958e169:::16:head 2021-01-27T09:32:32.552 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:4d4dabf9:::17:head 2021-01-27T09:32:32.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:8391935d:::18:head 2021-01-27T09:32:32.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:28883081:::19:head 2021-01-27T09:32:32.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:69259c59:::20:head 2021-01-27T09:32:32.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:4bdb80b7:::21:head 2021-01-27T09:32:32.553 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a11c5d71:::22:head 2021-01-27T09:32:32.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:271af37b:::23:head 2021-01-27T09:32:32.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:95b121be:::24:head 2021-01-27T09:32:32.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:58d1031b:::25:head 2021-01-27T09:32:32.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:0a050783:::26:head 2021-01-27T09:32:32.554 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c709704c:::27:head 2021-01-27T09:32:32.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:cbe56eaf:::28:head 2021-01-27T09:32:32.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:86b4b162:::29:head 2021-01-27T09:32:32.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:70d89383:::30:head 2021-01-27T09:32:32.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:dd450c7c:::31:head 2021-01-27T09:32:32.555 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6d5729b1:::32:head 2021-01-27T09:32:32.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c388f3fb:::33:head 2021-01-27T09:32:32.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:56cfea31:::34:head 2021-01-27T09:32:32.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9dbc1bf7:::35:head 2021-01-27T09:32:32.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:40b74ccd:::36:head 2021-01-27T09:32:32.556 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:4d5aaf42:::37:head 2021-01-27T09:32:32.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:920f362c:::38:head 2021-01-27T09:32:32.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6cc53222:::39:head 2021-01-27T09:32:32.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9cad833f:::40:head 2021-01-27T09:32:32.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:1ea84d41:::41:head 2021-01-27T09:32:32.557 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c4480ef6:::42:head 2021-01-27T09:32:32.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a694361e:::43:head 2021-01-27T09:32:32.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d1bd33e9:::44:head 2021-01-27T09:32:32.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:ddc2cd5d:::45:head 2021-01-27T09:32:32.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:2b782207:::46:head 2021-01-27T09:32:32.558 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:7b187fca:::47:head 2021-01-27T09:32:32.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:90ecdf6f:::48:head 2021-01-27T09:32:32.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a5ed95fe:::49:head 2021-01-27T09:32:32.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:ea0eaa55:::50:head 2021-01-27T09:32:32.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f33ef17b:::51:head 2021-01-27T09:32:32.559 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a0d1b2f6:::52:head 2021-01-27T09:32:32.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:60c5229e:::53:head 2021-01-27T09:32:32.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:edcbc575:::54:head 2021-01-27T09:32:32.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:102cf253:::55:head 2021-01-27T09:32:32.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:efb7fb0b:::56:head 2021-01-27T09:32:32.560 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:50d0a326:::57:head 2021-01-27T09:32:32.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d4dc5daf:::58:head 2021-01-27T09:32:32.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3a130462:::59:head 2021-01-27T09:32:32.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:ec87ed71:::60:head 2021-01-27T09:32:32.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d5bc9454:::61:head 2021-01-27T09:32:32.561 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3ddfe313:::62:head 2021-01-27T09:32:32.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:7c2816b9:::63:head 2021-01-27T09:32:32.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:47e00e4d:::64:head 2021-01-27T09:32:32.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c6410c18:::65:head 2021-01-27T09:32:32.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b48ed237:::66:head 2021-01-27T09:32:32.562 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:cd63ad31:::67:head 2021-01-27T09:32:32.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b179e92b:::68:head 2021-01-27T09:32:32.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:0d9f741a:::69:head 2021-01-27T09:32:32.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6d3352ae:::70:head 2021-01-27T09:32:32.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c6d5c19e:::71:head 2021-01-27T09:32:32.563 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:bc4729c3:::72:head 2021-01-27T09:32:32.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:77e930b9:::73:head 2021-01-27T09:32:32.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:0abeecfd:::74:head 2021-01-27T09:32:32.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b7c37e15:::75:head 2021-01-27T09:32:32.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b6378398:::76:head 2021-01-27T09:32:32.564 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:02bd68de:::77:head 2021-01-27T09:32:32.565 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:cc795d2d:::78:head 2021-01-27T09:32:32.565 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:630d4fea:::79:head 2021-01-27T09:32:32.565 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:e0d29ef5:::80:head 2021-01-27T09:32:32.565 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:fd6f13d2:::81:head 2021-01-27T09:32:32.565 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:606461d5:::82:head 2021-01-27T09:32:32.566 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:eadbdc43:::83:head 2021-01-27T09:32:32.566 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:8761d0bb:::84:head 2021-01-27T09:32:32.566 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9ef0186f:::85:head 2021-01-27T09:32:32.566 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:e0d41294:::86:head 2021-01-27T09:32:32.566 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:961de695:::87:head 2021-01-27T09:32:32.567 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:1423148f:::88:head 2021-01-27T09:32:32.567 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:633a8fa2:::89:head 2021-01-27T09:32:32.567 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a8653809:::90:head 2021-01-27T09:32:32.567 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3dac8b33:::91:head 2021-01-27T09:32:32.567 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:35aad435:::92:head 2021-01-27T09:32:32.568 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f6dcc343:::93:head 2021-01-27T09:32:32.568 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:dbbdad87:::94:head 2021-01-27T09:32:32.568 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:1cb48ce0:::95:head 2021-01-27T09:32:32.568 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:03cd461c:::96:head 2021-01-27T09:32:32.568 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:17a4ea99:::97:head 2021-01-27T09:32:32.569 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9993c9a7:::98:head 2021-01-27T09:32:32.569 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6394211c:::99:head 2021-01-27T09:32:32.569 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:94c7ae57:::100:head 2021-01-27T09:32:32.569 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6fdee5bb:::101:head 2021-01-27T09:32:32.569 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9a477fd1:::102:head 2021-01-27T09:32:32.570 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:eb850916:::103:head 2021-01-27T09:32:32.570 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:affc56b9:::104:head 2021-01-27T09:32:32.570 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b42dc814:::105:head 2021-01-27T09:32:32.570 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f319f8f0:::106:head 2021-01-27T09:32:32.570 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9a40b9de:::107:head 2021-01-27T09:32:32.571 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:8b524f28:::108:head 2021-01-27T09:32:32.571 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:e3de589f:::109:head 2021-01-27T09:32:32.571 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:90f90a5b:::110:head 2021-01-27T09:32:32.571 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a7b4f1d7:::111:head 2021-01-27T09:32:32.571 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:af51766e:::112:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:b6f90bd1:::113:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:e0261208:::114:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c9569ef7:::115:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:61bebe50:::116:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:fe93412b:::117:head 2021-01-27T09:32:32.572 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d3d38bee:::118:head 2021-01-27T09:32:32.573 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3100ba0c:::119:head 2021-01-27T09:32:32.573 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d0560ada:::120:head 2021-01-27T09:32:32.573 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f0ea8b35:::121:head 2021-01-27T09:32:32.573 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:766f231a:::122:head 2021-01-27T09:32:32.573 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a07a2582:::123:head 2021-01-27T09:32:32.574 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:bd7c6b3a:::124:head 2021-01-27T09:32:32.574 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:fb2ddaff:::125:head 2021-01-27T09:32:32.574 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:4408e1fe:::126:head 2021-01-27T09:32:32.574 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:ee1df7a7:::127:head 2021-01-27T09:32:32.574 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c3002909:::128:head 2021-01-27T09:32:32.575 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:4f48ffa9:::129:head 2021-01-27T09:32:32.575 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:edf38733:::130:head 2021-01-27T09:32:32.575 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c08425c0:::131:head 2021-01-27T09:32:32.575 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:5f902d98:::132:head 2021-01-27T09:32:32.575 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:41ea2c93:::133:head 2021-01-27T09:32:32.576 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:813cee13:::134:head 2021-01-27T09:32:32.576 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:0131818d:::135:head 2021-01-27T09:32:32.576 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:26ba5a85:::136:head 2021-01-27T09:32:32.576 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:381b8a5a:::137:head 2021-01-27T09:32:32.576 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:28797e47:::138:head 2021-01-27T09:32:32.577 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:bfca7f22:::139:head 2021-01-27T09:32:32.577 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:36807075:::140:head 2021-01-27T09:32:32.577 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:80b03975:::141:head 2021-01-27T09:32:32.577 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:5c15709b:::142:head 2021-01-27T09:32:32.577 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f39ea15e:::143:head 2021-01-27T09:32:32.578 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:ea992956:::144:head 2021-01-27T09:32:32.578 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:48887b1c:::145:head 2021-01-27T09:32:32.578 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:9f24a9dd:::146:head 2021-01-27T09:32:32.578 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:987f100b:::147:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d2dd3581:::148:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:7fed1808:::149:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c80b70e9:::150:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:85ed90f9:::151:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:36428b24:::152:head 2021-01-27T09:32:32.579 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d044c34a:::153:head 2021-01-27T09:32:32.580 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:7c18bf58:::154:head 2021-01-27T09:32:32.580 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d1c21232:::155:head 2021-01-27T09:32:32.580 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:a7a3c575:::156:head 2021-01-27T09:32:32.580 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:87da0633:::157:head 2021-01-27T09:32:32.580 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:d5ac3822:::158:head 2021-01-27T09:32:32.581 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:3f20522d:::159:head 2021-01-27T09:32:32.581 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:6ca26563:::160:head 2021-01-27T09:32:32.581 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:532ce135:::161:head 2021-01-27T09:32:32.581 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:c78863e6:::162:head 2021-01-27T09:32:32.581 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:7462ddf6:::163:head 2021-01-27T09:32:32.582 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:5d165639:::164:head 2021-01-27T09:32:32.582 INFO:tasks.workunit.client.0.smithi103.stdout: api_tier_pp: checking for 186:f43765fc:::165:head 2021-01-27T09:32:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[9772]: audit 2021-01-27T09:32:31.418501+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-01-27T09:32:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[9772]: cluster 2021-01-27T09:32:31.846057+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T09:32:33.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[9772]: audit 2021-01-27T09:32:32.420550+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[9772]: cluster 2021-01-27T09:32:32.420872+0000 mon.a (mon.0) 1938 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T09:32:33.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[9772]: audit 2021-01-27T09:32:32.540593+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-41","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:33.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[13570]: audit 2021-01-27T09:32:31.418501+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-01-27T09:32:33.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[13570]: cluster 2021-01-27T09:32:31.846057+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T09:32:33.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[13570]: audit 2021-01-27T09:32:32.420550+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:33.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[13570]: cluster 2021-01-27T09:32:32.420872+0000 mon.a (mon.0) 1938 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T09:32:33.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:32 smithi103 bash[13570]: audit 2021-01-27T09:32:32.540593+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-41","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:33.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:32 smithi047 bash[9721]: audit 2021-01-27T09:32:31.418501+0000 mon.a (mon.0) 1935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-01-27T09:32:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:32 smithi047 bash[9721]: cluster 2021-01-27T09:32:31.846057+0000 mon.a (mon.0) 1936 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T09:32:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:32 smithi047 bash[9721]: audit 2021-01-27T09:32:32.420550+0000 mon.a (mon.0) 1937 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:33.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:32 smithi047 bash[9721]: cluster 2021-01-27T09:32:32.420872+0000 mon.a (mon.0) 1938 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T09:32:33.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:32 smithi047 bash[9721]: audit 2021-01-27T09:32:32.540593+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi103-32354-41","var": "pg_num","format": "json"}]: dispatch 2021-01-27T09:32:34.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: cluster 2021-01-27T09:32:32.462846+0000 mgr.y (mgr.14138) 651 : cluster [DBG] pgmap v685: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:34.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: audit 2021-01-27T09:32:32.954214+0000 mon.b (mon.2) 207 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: audit 2021-01-27T09:32:32.955626+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: audit 2021-01-27T09:32:32.956250+0000 mon.b (mon.2) 208 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: audit 2021-01-27T09:32:32.957471+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: audit 2021-01-27T09:32:33.428604+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]': finished 2021-01-27T09:32:34.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[13570]: cluster 2021-01-27T09:32:33.429156+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T09:32:34.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: cluster 2021-01-27T09:32:32.462846+0000 mgr.y (mgr.14138) 651 : cluster [DBG] pgmap v685: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:34.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: audit 2021-01-27T09:32:32.954214+0000 mon.b (mon.2) 207 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: audit 2021-01-27T09:32:32.955626+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: audit 2021-01-27T09:32:32.956250+0000 mon.b (mon.2) 208 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: audit 2021-01-27T09:32:32.957471+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: audit 2021-01-27T09:32:33.428604+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]': finished 2021-01-27T09:32:34.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:33 smithi103 bash[9772]: cluster 2021-01-27T09:32:33.429156+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T09:32:34.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: cluster 2021-01-27T09:32:32.462846+0000 mgr.y (mgr.14138) 651 : cluster [DBG] pgmap v685: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 312 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:34.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: audit 2021-01-27T09:32:32.954214+0000 mon.b (mon.2) 207 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: audit 2021-01-27T09:32:32.955626+0000 mon.a (mon.0) 1939 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: audit 2021-01-27T09:32:32.956250+0000 mon.b (mon.2) 208 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: audit 2021-01-27T09:32:32.957471+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]: dispatch 2021-01-27T09:32:34.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: audit 2021-01-27T09:32:33.428604+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-41"}]': finished 2021-01-27T09:32:34.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:33 smithi047 bash[9721]: cluster 2021-01-27T09:32:33.429156+0000 mon.a (mon.0) 1942 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T09:32:34.643 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[10018]: debug 2021-01-27T09:32:34.299+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:34.802 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:34 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:35.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[9772]: audit 2021-01-27T09:32:34.303197+0000 mgr.y (mgr.14138) 652 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:35.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[9772]: cluster 2021-01-27T09:32:34.429487+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T09:32:35.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[9772]: audit 2021-01-27T09:32:34.431421+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:35.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[9772]: audit 2021-01-27T09:32:34.432105+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:35.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[13570]: audit 2021-01-27T09:32:34.303197+0000 mgr.y (mgr.14138) 652 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:35.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[13570]: cluster 2021-01-27T09:32:34.429487+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T09:32:35.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[13570]: audit 2021-01-27T09:32:34.431421+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:35.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:34 smithi103 bash[13570]: audit 2021-01-27T09:32:34.432105+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:35.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:34 smithi047 bash[9721]: audit 2021-01-27T09:32:34.303197+0000 mgr.y (mgr.14138) 652 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:35.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:34 smithi047 bash[9721]: cluster 2021-01-27T09:32:34.429487+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T09:32:35.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:34 smithi047 bash[9721]: audit 2021-01-27T09:32:34.431421+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:35.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:34 smithi047 bash[9721]: audit 2021-01-27T09:32:34.432105+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: cluster 2021-01-27T09:32:34.463569+0000 mgr.y (mgr.14138) 653 : cluster [DBG] pgmap v688: 196 pgs: 196 active+clean; 3.8 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:36.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: audit 2021-01-27T09:32:35.440097+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:36.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: cluster 2021-01-27T09:32:35.440264+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T09:32:36.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: audit 2021-01-27T09:32:35.444162+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: audit 2021-01-27T09:32:35.444596+0000 mon.b (mon.2) 209 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:36.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: audit 2021-01-27T09:32:35.445556+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.305 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:35 smithi047 bash[9721]: audit 2021-01-27T09:32:35.446167+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:36.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: cluster 2021-01-27T09:32:34.463569+0000 mgr.y (mgr.14138) 653 : cluster [DBG] pgmap v688: 196 pgs: 196 active+clean; 3.8 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:36.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: audit 2021-01-27T09:32:35.440097+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:36.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: cluster 2021-01-27T09:32:35.440264+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T09:32:36.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: audit 2021-01-27T09:32:35.444162+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: audit 2021-01-27T09:32:35.444596+0000 mon.b (mon.2) 209 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:36.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: audit 2021-01-27T09:32:35.445556+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[9772]: audit 2021-01-27T09:32:35.446167+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:36.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: cluster 2021-01-27T09:32:34.463569+0000 mgr.y (mgr.14138) 653 : cluster [DBG] pgmap v688: 196 pgs: 196 active+clean; 3.8 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:36.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: audit 2021-01-27T09:32:35.440097+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:36.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: cluster 2021-01-27T09:32:35.440264+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T09:32:36.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: audit 2021-01-27T09:32:35.444162+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.103:0/4071087900' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: audit 2021-01-27T09:32:35.444596+0000 mon.b (mon.2) 209 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:36.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: audit 2021-01-27T09:32:35.445556+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]: dispatch 2021-01-27T09:32:36.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:35 smithi103 bash[13570]: audit 2021-01-27T09:32:35.446167+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.442351+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:37.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.442734+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:37.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: cluster 2021-01-27T09:32:36.443457+0000 mon.a (mon.0) 1951 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T09:32:37.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.448317+0000 mon.b (mon.2) 210 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.457214+0000 mon.a (mon.0) 1952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: cluster 2021-01-27T09:32:36.464223+0000 mgr.y (mgr.14138) 654 : cluster [DBG] pgmap v691: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 3.8 MiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:37.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.483048+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.483618+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.484431+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.484722+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.485265+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:37.805 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:37 smithi047 bash[9721]: audit 2021-01-27T09:32:36.485514+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:37.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.442351+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.442734+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: cluster 2021-01-27T09:32:36.443457+0000 mon.a (mon.0) 1951 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T09:32:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.448317+0000 mon.b (mon.2) 210 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.457214+0000 mon.a (mon.0) 1952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: cluster 2021-01-27T09:32:36.464223+0000 mgr.y (mgr.14138) 654 : cluster [DBG] pgmap v691: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 3.8 MiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.483048+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.483618+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.484431+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.484722+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.485265+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:37.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[13570]: audit 2021-01-27T09:32:36.485514+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:37.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.442351+0000 mon.a (mon.0) 1949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-54"}]': finished 2021-01-27T09:32:37.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.442734+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:37.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: cluster 2021-01-27T09:32:36.443457+0000 mon.a (mon.0) 1951 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T09:32:37.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.448317+0000 mon.b (mon.2) 210 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.457214+0000 mon.a (mon.0) 1952 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:37.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: cluster 2021-01-27T09:32:36.464223+0000 mgr.y (mgr.14138) 654 : cluster [DBG] pgmap v691: 228 pgs: 2 creating+peering, 30 unknown, 196 active+clean; 3.8 MiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:37.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.483048+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.483618+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.484431+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.484722+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:37.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.485265+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:37.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:37 smithi103 bash[9772]: audit 2021-01-27T09:32:36.485514+0000 mon.a (mon.0) 1955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:39.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.452814+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:39.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.452900+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:39.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: cluster 2021-01-27T09:32:37.452979+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T09:32:39.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.455460+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.455910+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.457434+0000 mon.b (mon.2) 211 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:39.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[9772]: audit 2021-01-27T09:32:37.458621+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.452814+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.452900+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: cluster 2021-01-27T09:32:37.452979+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T09:32:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.455460+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.455910+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.457434+0000 mon.b (mon.2) 211 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:38 smithi103 bash[13570]: audit 2021-01-27T09:32:37.458621+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:39.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.452814+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:39.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.452900+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:39.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: cluster 2021-01-27T09:32:37.452979+0000 mon.a (mon.0) 1958 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T09:32:39.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.455460+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.455910+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:39.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.457434+0000 mon.b (mon.2) 211 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:39.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:38 smithi047 bash[9721]: audit 2021-01-27T09:32:37.458621+0000 mon.a (mon.0) 1960 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]: dispatch 2021-01-27T09:32:40.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: cluster 2021-01-27T09:32:38.464851+0000 mgr.y (mgr.14138) 655 : cluster [DBG] pgmap v694: 228 pgs: 2 creating+peering, 15 unknown, 211 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:40.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:38.888343+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]': finished 2021-01-27T09:32:40.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: cluster 2021-01-27T09:32:38.888551+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T09:32:40.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:38.889207+0000 mon.b (mon.2) 212 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:38.891208+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:39.466179+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:40.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:39.466437+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]': finished 2021-01-27T09:32:40.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: cluster 2021-01-27T09:32:39.466612+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T09:32:40.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:39.468287+0000 mon.b (mon.2) 213 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:40.304 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:39 smithi047 bash[9721]: audit 2021-01-27T09:32:39.469791+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:40.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: cluster 2021-01-27T09:32:38.464851+0000 mgr.y (mgr.14138) 655 : cluster [DBG] pgmap v694: 228 pgs: 2 creating+peering, 15 unknown, 211 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:40.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:38.888343+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]': finished 2021-01-27T09:32:40.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: cluster 2021-01-27T09:32:38.888551+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T09:32:40.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:38.889207+0000 mon.b (mon.2) 212 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:38.891208+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:39.466179+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:40.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:39.466437+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]': finished 2021-01-27T09:32:40.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: cluster 2021-01-27T09:32:39.466612+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T09:32:40.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:39.468287+0000 mon.b (mon.2) 213 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:40.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[13570]: audit 2021-01-27T09:32:39.469791+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:40.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: cluster 2021-01-27T09:32:38.464851+0000 mgr.y (mgr.14138) 655 : cluster [DBG] pgmap v694: 228 pgs: 2 creating+peering, 15 unknown, 211 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:40.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:38.888343+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_count","val": "3"}]': finished 2021-01-27T09:32:40.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: cluster 2021-01-27T09:32:38.888551+0000 mon.a (mon.0) 1962 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T09:32:40.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:38.889207+0000 mon.b (mon.2) 212 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:38.891208+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]: dispatch 2021-01-27T09:32:40.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:39.466179+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:40.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:39.466437+0000 mon.a (mon.0) 1965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_period","val": "3"}]': finished 2021-01-27T09:32:40.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: cluster 2021-01-27T09:32:39.466612+0000 mon.a (mon.0) 1966 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T09:32:40.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:39.468287+0000 mon.b (mon.2) 213 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:40.398 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:39 smithi103 bash[9772]: audit 2021-01-27T09:32:39.469791+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:32:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:41 smithi047 bash[9721]: cluster 2021-01-27T09:32:40.465820+0000 mgr.y (mgr.14138) 656 : cluster [DBG] pgmap v697: 236 pgs: 5 creating+peering, 5 unknown, 226 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:41 smithi047 bash[9721]: audit 2021-01-27T09:32:40.468451+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:32:41.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:41 smithi047 bash[9721]: cluster 2021-01-27T09:32:40.468865+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T09:32:41.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:41 smithi047 bash[9721]: audit 2021-01-27T09:32:40.473207+0000 mon.b (mon.2) 214 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:41.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:41 smithi047 bash[9721]: audit 2021-01-27T09:32:40.478815+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:41.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[13570]: cluster 2021-01-27T09:32:40.465820+0000 mgr.y (mgr.14138) 656 : cluster [DBG] pgmap v697: 236 pgs: 5 creating+peering, 5 unknown, 226 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:41.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[13570]: audit 2021-01-27T09:32:40.468451+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:32:41.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[13570]: cluster 2021-01-27T09:32:40.468865+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T09:32:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[13570]: audit 2021-01-27T09:32:40.473207+0000 mon.b (mon.2) 214 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:41.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[13570]: audit 2021-01-27T09:32:40.478815+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:41.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[9772]: cluster 2021-01-27T09:32:40.465820+0000 mgr.y (mgr.14138) 656 : cluster [DBG] pgmap v697: 236 pgs: 5 creating+peering, 5 unknown, 226 active+clean; 3.8 MiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:41.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[9772]: audit 2021-01-27T09:32:40.468451+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:32:41.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[9772]: cluster 2021-01-27T09:32:40.468865+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T09:32:41.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[9772]: audit 2021-01-27T09:32:40.473207+0000 mon.b (mon.2) 214 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:41.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:41 smithi103 bash[9772]: audit 2021-01-27T09:32:40.478815+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-01-27T09:32:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:42 smithi047 bash[9721]: audit 2021-01-27T09:32:41.471340+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]': finished 2021-01-27T09:32:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:42 smithi047 bash[9721]: cluster 2021-01-27T09:32:41.471624+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T09:32:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:42 smithi047 bash[9721]: audit 2021-01-27T09:32:41.473505+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:42.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:42 smithi047 bash[9721]: audit 2021-01-27T09:32:41.481964+0000 mon.a (mon.0) 1973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:42.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[9772]: audit 2021-01-27T09:32:41.471340+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]': finished 2021-01-27T09:32:42.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[9772]: cluster 2021-01-27T09:32:41.471624+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T09:32:42.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[9772]: audit 2021-01-27T09:32:41.473505+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:42.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[9772]: audit 2021-01-27T09:32:41.481964+0000 mon.a (mon.0) 1973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:42.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[13570]: audit 2021-01-27T09:32:41.471340+0000 mon.a (mon.0) 1971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-43","var": "hit_set_fpp","val": ".01"}]': finished 2021-01-27T09:32:42.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[13570]: cluster 2021-01-27T09:32:41.471624+0000 mon.a (mon.0) 1972 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T09:32:42.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[13570]: audit 2021-01-27T09:32:41.473505+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:42.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:42 smithi103 bash[13570]: audit 2021-01-27T09:32:41.481964+0000 mon.a (mon.0) 1973 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:43 smithi047 bash[9721]: cluster 2021-01-27T09:32:42.466722+0000 mgr.y (mgr.14138) 657 : cluster [DBG] pgmap v699: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:43 smithi047 bash[9721]: audit 2021-01-27T09:32:42.484775+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:43.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:43 smithi047 bash[9721]: cluster 2021-01-27T09:32:42.484995+0000 mon.a (mon.0) 1975 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T09:32:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:43 smithi047 bash[9721]: audit 2021-01-27T09:32:42.488244+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:43 smithi047 bash[9721]: audit 2021-01-27T09:32:42.494375+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[13570]: cluster 2021-01-27T09:32:42.466722+0000 mgr.y (mgr.14138) 657 : cluster [DBG] pgmap v699: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:43.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[13570]: audit 2021-01-27T09:32:42.484775+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:43.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[13570]: cluster 2021-01-27T09:32:42.484995+0000 mon.a (mon.0) 1975 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T09:32:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[13570]: audit 2021-01-27T09:32:42.488244+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[13570]: audit 2021-01-27T09:32:42.494375+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[9772]: cluster 2021-01-27T09:32:42.466722+0000 mgr.y (mgr.14138) 657 : cluster [DBG] pgmap v699: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:43.899 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[9772]: audit 2021-01-27T09:32:42.484775+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:43.900 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[9772]: cluster 2021-01-27T09:32:42.484995+0000 mon.a (mon.0) 1975 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T09:32:43.901 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[9772]: audit 2021-01-27T09:32:42.488244+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.103:0/1182806225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:43.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:43 smithi103 bash[9772]: audit 2021-01-27T09:32:42.494375+0000 mon.a (mon.0) 1976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]: dispatch 2021-01-27T09:32:44.644 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[10018]: debug 2021-01-27T09:32:44.307+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:44.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[13570]: audit 2021-01-27T09:32:43.505758+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:44.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[13570]: cluster 2021-01-27T09:32:43.505868+0000 mon.a (mon.0) 1978 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T09:32:44.645 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[13570]: audit 2021-01-27T09:32:44.312750+0000 mgr.y (mgr.14138) 658 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:44.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[9772]: audit 2021-01-27T09:32:43.505758+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:44.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[9772]: cluster 2021-01-27T09:32:43.505868+0000 mon.a (mon.0) 1978 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T09:32:44.646 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:44 smithi103 bash[9772]: audit 2021-01-27T09:32:44.312750+0000 mgr.y (mgr.14138) 658 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:44.802 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:44 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:44 smithi047 bash[9721]: audit 2021-01-27T09:32:43.505758+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-55"}]': finished 2021-01-27T09:32:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:44 smithi047 bash[9721]: cluster 2021-01-27T09:32:43.505868+0000 mon.a (mon.0) 1978 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T09:32:44.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:44 smithi047 bash[9721]: audit 2021-01-27T09:32:44.312750+0000 mgr.y (mgr.14138) 658 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:45.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:45 smithi047 bash[9721]: cluster 2021-01-27T09:32:44.467984+0000 mgr.y (mgr.14138) 659 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:45.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:45 smithi047 bash[9721]: cluster 2021-01-27T09:32:44.520237+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T09:32:45.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:45 smithi047 bash[9721]: audit 2021-01-27T09:32:44.522417+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:45.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[9772]: cluster 2021-01-27T09:32:44.467984+0000 mgr.y (mgr.14138) 659 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:45.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[9772]: cluster 2021-01-27T09:32:44.520237+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T09:32:45.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[9772]: audit 2021-01-27T09:32:44.522417+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:45.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[13570]: cluster 2021-01-27T09:32:44.467984+0000 mgr.y (mgr.14138) 659 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 320 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:45.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[13570]: cluster 2021-01-27T09:32:44.520237+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T09:32:45.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:45 smithi103 bash[13570]: audit 2021-01-27T09:32:44.522417+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:46.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:46 smithi047 bash[9721]: audit 2021-01-27T09:32:45.526637+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:46.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:46 smithi047 bash[9721]: cluster 2021-01-27T09:32:45.526884+0000 mon.a (mon.0) 1982 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T09:32:46.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:46 smithi103 bash[9772]: audit 2021-01-27T09:32:45.526637+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:46.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:46 smithi103 bash[9772]: cluster 2021-01-27T09:32:45.526884+0000 mon.a (mon.0) 1982 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T09:32:46.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:46 smithi103 bash[13570]: audit 2021-01-27T09:32:45.526637+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? 172.21.15.103:0/2661243080' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32172-56","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:46.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:46 smithi103 bash[13570]: cluster 2021-01-27T09:32:45.526884+0000 mon.a (mon.0) 1982 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T09:32:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: cluster 2021-01-27T09:32:46.469274+0000 mgr.y (mgr.14138) 660 : cluster [DBG] pgmap v705: 260 pgs: 10 creating+peering, 16 unknown, 234 active+clean; 3.8 MiB data, 321 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: cluster 2021-01-27T09:32:46.533421+0000 mon.a (mon.0) 1983 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T09:32:47.802 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.554384+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.554699+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.555633+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.556041+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.803 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.556668+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:47.804 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:47 smithi047 bash[9721]: audit 2021-01-27T09:32:46.557077+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:47.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: cluster 2021-01-27T09:32:46.469274+0000 mgr.y (mgr.14138) 660 : cluster [DBG] pgmap v705: 260 pgs: 10 creating+peering, 16 unknown, 234 active+clean; 3.8 MiB data, 321 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:47.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: cluster 2021-01-27T09:32:46.533421+0000 mon.a (mon.0) 1983 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T09:32:47.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.554384+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.554699+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.555633+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.556041+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.556668+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:47.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[9772]: audit 2021-01-27T09:32:46.557077+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:47.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: cluster 2021-01-27T09:32:46.469274+0000 mgr.y (mgr.14138) 660 : cluster [DBG] pgmap v705: 260 pgs: 10 creating+peering, 16 unknown, 234 active+clean; 3.8 MiB data, 321 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:47.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: cluster 2021-01-27T09:32:46.533421+0000 mon.a (mon.0) 1983 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T09:32:47.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.554384+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.554699+0000 mon.a (mon.0) 1984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.555633+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.556041+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:47.897 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.556668+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:47.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:47 smithi103 bash[13570]: audit 2021-01-27T09:32:46.557077+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:48.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[9772]: audit 2021-01-27T09:32:47.552762+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:48.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[9772]: cluster 2021-01-27T09:32:47.552880+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T09:32:48.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[9772]: audit 2021-01-27T09:32:47.554989+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:48.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[9772]: audit 2021-01-27T09:32:47.556032+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:48.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[13570]: audit 2021-01-27T09:32:47.552762+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:48.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[13570]: cluster 2021-01-27T09:32:47.552880+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T09:32:48.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[13570]: audit 2021-01-27T09:32:47.554989+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:48.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:48 smithi103 bash[13570]: audit 2021-01-27T09:32:47.556032+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:49.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:48 smithi047 bash[9721]: audit 2021-01-27T09:32:47.552762+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:49.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:48 smithi047 bash[9721]: cluster 2021-01-27T09:32:47.552880+0000 mon.a (mon.0) 1988 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T09:32:49.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:48 smithi047 bash[9721]: audit 2021-01-27T09:32:47.554989+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:49.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:48 smithi047 bash[9721]: audit 2021-01-27T09:32:47.556032+0000 mon.a (mon.0) 1989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:49.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:49 smithi103 bash[9772]: cluster 2021-01-27T09:32:48.470821+0000 mgr.y (mgr.14138) 661 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:49.894 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:49 smithi103 bash[9772]: cluster 2021-01-27T09:32:48.995009+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T09:32:49.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:49 smithi103 bash[13570]: cluster 2021-01-27T09:32:48.470821+0000 mgr.y (mgr.14138) 661 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:49.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:49 smithi103 bash[13570]: cluster 2021-01-27T09:32:48.995009+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T09:32:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:49 smithi047 bash[9721]: cluster 2021-01-27T09:32:48.470821+0000 mgr.y (mgr.14138) 661 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-27T09:32:50.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:49 smithi047 bash[9721]: cluster 2021-01-27T09:32:48.995009+0000 mon.a (mon.0) 1990 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T09:32:50.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[13570]: audit 2021-01-27T09:32:49.574167+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:50.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[13570]: cluster 2021-01-27T09:32:49.574294+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T09:32:50.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[13570]: cluster 2021-01-27T09:32:50.574552+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T09:32:50.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[9772]: audit 2021-01-27T09:32:49.574167+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:50.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[9772]: cluster 2021-01-27T09:32:49.574294+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T09:32:50.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:50 smithi103 bash[9772]: cluster 2021-01-27T09:32:50.574552+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T09:32:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:50 smithi047 bash[9721]: audit 2021-01-27T09:32:49.574167+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:50 smithi047 bash[9721]: cluster 2021-01-27T09:32:49.574294+0000 mon.a (mon.0) 1992 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T09:32:51.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:50 smithi047 bash[9721]: cluster 2021-01-27T09:32:50.574552+0000 mon.a (mon.0) 1993 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T09:32:52.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[13570]: cluster 2021-01-27T09:32:50.472260+0000 mgr.y (mgr.14138) 662 : cluster [DBG] pgmap v711: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:52.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[13570]: cluster 2021-01-27T09:32:51.592568+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T09:32:52.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[13570]: audit 2021-01-27T09:32:51.596632+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:52.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[13570]: audit 2021-01-27T09:32:51.597013+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:52.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[9772]: cluster 2021-01-27T09:32:50.472260+0000 mgr.y (mgr.14138) 662 : cluster [DBG] pgmap v711: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:52.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[9772]: cluster 2021-01-27T09:32:51.592568+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T09:32:52.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[9772]: audit 2021-01-27T09:32:51.596632+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:52.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:52 smithi103 bash[9772]: audit 2021-01-27T09:32:51.597013+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:52 smithi047 bash[9721]: cluster 2021-01-27T09:32:50.472260+0000 mgr.y (mgr.14138) 662 : cluster [DBG] pgmap v711: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 3.8 MiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:52 smithi047 bash[9721]: cluster 2021-01-27T09:32:51.592568+0000 mon.a (mon.0) 1994 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T09:32:52.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:52 smithi047 bash[9721]: audit 2021-01-27T09:32:51.596632+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:52.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:52 smithi047 bash[9721]: audit 2021-01-27T09:32:51.597013+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[13570]: cluster 2021-01-27T09:32:52.472941+0000 mgr.y (mgr.14138) 663 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:53.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[13570]: audit 2021-01-27T09:32:52.594631+0000 mon.a (mon.0) 1996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[13570]: cluster 2021-01-27T09:32:52.594797+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T09:32:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[13570]: audit 2021-01-27T09:32:52.596169+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:53.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[13570]: audit 2021-01-27T09:32:52.596803+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:53.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[9772]: cluster 2021-01-27T09:32:52.472941+0000 mgr.y (mgr.14138) 663 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:53.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[9772]: audit 2021-01-27T09:32:52.594631+0000 mon.a (mon.0) 1996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:53.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[9772]: cluster 2021-01-27T09:32:52.594797+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T09:32:53.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[9772]: audit 2021-01-27T09:32:52.596169+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:53.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:53 smithi103 bash[9772]: audit 2021-01-27T09:32:52.596803+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:54.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:53 smithi047 bash[9721]: cluster 2021-01-27T09:32:52.472941+0000 mgr.y (mgr.14138) 663 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-27T09:32:54.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:53 smithi047 bash[9721]: audit 2021-01-27T09:32:52.594631+0000 mon.a (mon.0) 1996 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:54.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:53 smithi047 bash[9721]: cluster 2021-01-27T09:32:52.594797+0000 mon.a (mon.0) 1997 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T09:32:54.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:53 smithi047 bash[9721]: audit 2021-01-27T09:32:52.596169+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.103:0/2904756062' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:54.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:53 smithi047 bash[9721]: audit 2021-01-27T09:32:52.596803+0000 mon.a (mon.0) 1998 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]: dispatch 2021-01-27T09:32:54.620 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:32:54.621 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.597106+0000 mon.b (mon.2) 215 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.621 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.598870+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:54.621 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: cluster 2021-01-27T09:32:53.599007+0000 mon.a (mon.0) 2000 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T09:32:54.621 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.600749+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.622 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.601866+0000 mon.b (mon.2) 216 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.622 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.607518+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.622 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.621388+0000 mon.a (mon.0) 2003 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.622 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.622473+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.622 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:53.622960+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:54.623 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:54 smithi047 bash[9721]: audit 2021-01-27T09:32:54.324136+0000 mgr.y (mgr.14138) 664 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:54.623 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[10018]: debug 2021-01-27T09:32:54.322+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:32:54.623 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.597106+0000 mon.b (mon.2) 215 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.623 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.598870+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:54.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: cluster 2021-01-27T09:32:53.599007+0000 mon.a (mon.0) 2000 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T09:32:54.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.600749+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.601866+0000 mon.b (mon.2) 216 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.607518+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.621388+0000 mon.a (mon.0) 2003 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.622473+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:53.622960+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:54.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[9772]: audit 2021-01-27T09:32:54.324136+0000 mgr.y (mgr.14138) 664 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:54.626 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.597106+0000 mon.b (mon.2) 215 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.626 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.598870+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-57"}]': finished 2021-01-27T09:32:54.626 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: cluster 2021-01-27T09:32:53.599007+0000 mon.a (mon.0) 2000 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T09:32:54.627 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.600749+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:32:54.627 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.601866+0000 mon.b (mon.2) 216 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.627 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.607518+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]: dispatch 2021-01-27T09:32:54.628 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.621388+0000 mon.a (mon.0) 2003 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.628 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.622473+0000 mon.a (mon.0) 2004 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:54.628 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:53.622960+0000 mon.a (mon.0) 2005 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:32:54.629 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:54 smithi103 bash[13570]: audit 2021-01-27T09:32:54.324136+0000 mgr.y (mgr.14138) 664 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:32:56.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:56 smithi047 bash[9721]: cluster 2021-01-27T09:32:54.474006+0000 mgr.y (mgr.14138) 665 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:56.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:56 smithi047 bash[9721]: audit 2021-01-27T09:32:54.610980+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]': finished 2021-01-27T09:32:56.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:56 smithi047 bash[9721]: audit 2021-01-27T09:32:54.611194+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:56.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:56 smithi047 bash[9721]: cluster 2021-01-27T09:32:54.611332+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2021-01-27T09:32:56.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:56 smithi047 bash[9721]: audit 2021-01-27T09:32:54.613018+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:56.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[13570]: cluster 2021-01-27T09:32:54.474006+0000 mgr.y (mgr.14138) 665 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:56.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[13570]: audit 2021-01-27T09:32:54.610980+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]': finished 2021-01-27T09:32:56.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[13570]: audit 2021-01-27T09:32:54.611194+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:56.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[13570]: cluster 2021-01-27T09:32:54.611332+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2021-01-27T09:32:56.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[13570]: audit 2021-01-27T09:32:54.613018+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:56.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[9772]: cluster 2021-01-27T09:32:54.474006+0000 mgr.y (mgr.14138) 665 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-27T09:32:56.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[9772]: audit 2021-01-27T09:32:54.610980+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-43"}]': finished 2021-01-27T09:32:56.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[9772]: audit 2021-01-27T09:32:54.611194+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:32:56.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[9772]: cluster 2021-01-27T09:32:54.611332+0000 mon.a (mon.0) 2008 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2021-01-27T09:32:56.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:56 smithi103 bash[9772]: audit 2021-01-27T09:32:54.613018+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:57.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:57 smithi047 bash[9721]: cluster 2021-01-27T09:32:56.042904+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2021-01-27T09:32:57.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:57 smithi047 bash[9721]: audit 2021-01-27T09:32:56.620035+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:32:57.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:57 smithi047 bash[9721]: cluster 2021-01-27T09:32:56.620170+0000 mon.a (mon.0) 2012 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2021-01-27T09:32:57.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:57 smithi047 bash[9721]: audit 2021-01-27T09:32:56.625503+0000 mon.b (mon.2) 217 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:57.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:57 smithi047 bash[9721]: audit 2021-01-27T09:32:56.627337+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:57.394 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[9772]: cluster 2021-01-27T09:32:56.042904+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2021-01-27T09:32:57.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[9772]: audit 2021-01-27T09:32:56.620035+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:32:57.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[9772]: cluster 2021-01-27T09:32:56.620170+0000 mon.a (mon.0) 2012 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2021-01-27T09:32:57.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[9772]: audit 2021-01-27T09:32:56.625503+0000 mon.b (mon.2) 217 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:57.395 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[9772]: audit 2021-01-27T09:32:56.627337+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:57.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[13570]: cluster 2021-01-27T09:32:56.042904+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2021-01-27T09:32:57.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[13570]: audit 2021-01-27T09:32:56.620035+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:32:57.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[13570]: cluster 2021-01-27T09:32:56.620170+0000 mon.a (mon.0) 2012 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2021-01-27T09:32:57.396 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[13570]: audit 2021-01-27T09:32:56.625503+0000 mon.b (mon.2) 217 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:57.397 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:57 smithi103 bash[13570]: audit 2021-01-27T09:32:56.627337+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-27T09:32:58.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[13570]: cluster 2021-01-27T09:32:56.474716+0000 mgr.y (mgr.14138) 666 : cluster [DBG] pgmap v720: 196 pgs: 196 active+clean; 3.8 MiB data, 332 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:58.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[13570]: audit 2021-01-27T09:32:57.626596+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:58.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[13570]: cluster 2021-01-27T09:32:57.627278+0000 mon.a (mon.0) 2015 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2021-01-27T09:32:58.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[13570]: audit 2021-01-27T09:32:57.703612+0000 mon.b (mon.2) 218 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:58.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[13570]: audit 2021-01-27T09:32:57.705063+0000 mon.a (mon.0) 2016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:58.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[9772]: cluster 2021-01-27T09:32:56.474716+0000 mgr.y (mgr.14138) 666 : cluster [DBG] pgmap v720: 196 pgs: 196 active+clean; 3.8 MiB data, 332 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:58.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[9772]: audit 2021-01-27T09:32:57.626596+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:58.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[9772]: cluster 2021-01-27T09:32:57.627278+0000 mon.a (mon.0) 2015 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2021-01-27T09:32:58.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[9772]: audit 2021-01-27T09:32:57.703612+0000 mon.b (mon.2) 218 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:58.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:58 smithi103 bash[9772]: audit 2021-01-27T09:32:57.705063+0000 mon.a (mon.0) 2016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:58.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:58 smithi047 bash[9721]: cluster 2021-01-27T09:32:56.474716+0000 mgr.y (mgr.14138) 666 : cluster [DBG] pgmap v720: 196 pgs: 196 active+clean; 3.8 MiB data, 332 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:58.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:58 smithi047 bash[9721]: audit 2021-01-27T09:32:57.626596+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi103-32354-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-27T09:32:58.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:58 smithi047 bash[9721]: cluster 2021-01-27T09:32:57.627278+0000 mon.a (mon.0) 2015 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2021-01-27T09:32:58.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:58 smithi047 bash[9721]: audit 2021-01-27T09:32:57.703612+0000 mon.b (mon.2) 218 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:58.554 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:58 smithi047 bash[9721]: audit 2021-01-27T09:32:57.705063+0000 mon.a (mon.0) 2016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-27T09:32:59.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: cluster 2021-01-27T09:32:58.476120+0000 mgr.y (mgr.14138) 667 : cluster [DBG] pgmap v723: 236 pgs: 22 unknown, 214 active+clean; 3.8 MiB data, 337 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:59.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.629559+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:59.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: cluster 2021-01-27T09:32:58.629721+0000 mon.a (mon.0) 2018 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2021-01-27T09:32:59.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.630253+0000 mon.b (mon.2) 219 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:32:59.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.630828+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:59.895 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.631444+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:32:59.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.707057+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:32:59.896 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[13570]: audit 2021-01-27T09:32:58.740586+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:32:59.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: cluster 2021-01-27T09:32:58.476120+0000 mgr.y (mgr.14138) 667 : cluster [DBG] pgmap v723: 236 pgs: 22 unknown, 214 active+clean; 3.8 MiB data, 337 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:32:59.896 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.629559+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:32:59.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: cluster 2021-01-27T09:32:58.629721+0000 mon.a (mon.0) 2018 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2021-01-27T09:32:59.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.630253+0000 mon.b (mon.2) 219 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:32:59.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.630828+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:32:59.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.631444+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:32:59.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.707057+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:32:59.898 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:32:59 smithi103 bash[9772]: audit 2021-01-27T09:32:58.740586+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:33:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: cluster 2021-01-27T09:32:58.476120+0000 mgr.y (mgr.14138) 667 : cluster [DBG] pgmap v723: 236 pgs: 22 unknown, 214 active+clean; 3.8 MiB data, 337 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:33:00.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.629559+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45", "force_nonempty": "--force-nonempty" }]': finished 2021-01-27T09:33:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: cluster 2021-01-27T09:32:58.629721+0000 mon.a (mon.0) 2018 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2021-01-27T09:33:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.630253+0000 mon.b (mon.2) 219 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.630828+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:33:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.631444+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:00.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.707057+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T09:33:00.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:32:59 smithi047 bash[9721]: audit 2021-01-27T09:32:58.740586+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14138 172.21.15.103:0/139436980' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T09:33:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: audit 2021-01-27T09:32:59.639142+0000 mon.a (mon.0) 2023 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: audit 2021-01-27T09:32:59.639210+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]': finished 2021-01-27T09:33:01.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: cluster 2021-01-27T09:32:59.639267+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2021-01-27T09:33:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: audit 2021-01-27T09:32:59.640242+0000 mon.a (mon.0) 2026 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:33:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: audit 2021-01-27T09:32:59.645094+0000 mon.b (mon.2) 220 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:01.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:00 smithi047 bash[9721]: audit 2021-01-27T09:32:59.646596+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:01.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: audit 2021-01-27T09:32:59.639142+0000 mon.a (mon.0) 2023 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:01.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: audit 2021-01-27T09:32:59.639210+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]': finished 2021-01-27T09:33:01.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: cluster 2021-01-27T09:32:59.639267+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2021-01-27T09:33:01.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: audit 2021-01-27T09:32:59.640242+0000 mon.a (mon.0) 2026 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:33:01.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: audit 2021-01-27T09:32:59.645094+0000 mon.b (mon.2) 220 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:01.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[9772]: audit 2021-01-27T09:32:59.646596+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:01.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: audit 2021-01-27T09:32:59.639142+0000 mon.a (mon.0) 2023 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:01.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: audit 2021-01-27T09:32:59.639210+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi103-32354-6", "overlaypool": "test-rados-api-smithi103-32354-45"}]': finished 2021-01-27T09:33:01.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: cluster 2021-01-27T09:32:59.639267+0000 mon.a (mon.0) 2025 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2021-01-27T09:33:01.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: audit 2021-01-27T09:32:59.640242+0000 mon.a (mon.0) 2026 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]: dispatch 2021-01-27T09:33:01.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: audit 2021-01-27T09:32:59.645094+0000 mon.b (mon.2) 220 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:01.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:00 smithi103 bash[13570]: audit 2021-01-27T09:32:59.646596+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]: dispatch 2021-01-27T09:33:02.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: cluster 2021-01-27T09:33:00.477452+0000 mgr.y (mgr.14138) 668 : cluster [DBG] pgmap v726: 228 pgs: 6 unknown, 222 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2021-01-27T09:33:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: cluster 2021-01-27T09:33:00.636167+0000 mon.a (mon.0) 2028 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:33:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.644477+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.644638+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]': finished 2021-01-27T09:33:02.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: cluster 2021-01-27T09:33:00.644852+0000 mon.a (mon.0) 2031 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2021-01-27T09:33:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.647631+0000 mon.b (mon.2) 221 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.655324+0000 mon.a (mon.0) 2032 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.669548+0000 mon.a (mon.0) 2033 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.671310+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:01 smithi047 bash[9721]: audit 2021-01-27T09:33:00.671910+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: cluster 2021-01-27T09:33:00.477452+0000 mgr.y (mgr.14138) 668 : cluster [DBG] pgmap v726: 228 pgs: 6 unknown, 222 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2021-01-27T09:33:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: cluster 2021-01-27T09:33:00.636167+0000 mon.a (mon.0) 2028 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:33:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.644477+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:02.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.644638+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]': finished 2021-01-27T09:33:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: cluster 2021-01-27T09:33:00.644852+0000 mon.a (mon.0) 2031 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2021-01-27T09:33:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.647631+0000 mon.b (mon.2) 221 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.655324+0000 mon.a (mon.0) 2032 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.669548+0000 mon.a (mon.0) 2033 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.671310+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[9772]: audit 2021-01-27T09:33:00.671910+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:02.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: cluster 2021-01-27T09:33:00.477452+0000 mgr.y (mgr.14138) 668 : cluster [DBG] pgmap v726: 228 pgs: 6 unknown, 222 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2021-01-27T09:33:02.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: cluster 2021-01-27T09:33:00.636167+0000 mon.a (mon.0) 2028 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-27T09:33:02.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.644477+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.103:0/3291491495' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-58"}]': finished 2021-01-27T09:33:02.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.644638+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi103-32354-45", "mode": "writeback"}]': finished 2021-01-27T09:33:02.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: cluster 2021-01-27T09:33:00.644852+0000 mon.a (mon.0) 2031 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2021-01-27T09:33:02.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.647631+0000 mon.b (mon.2) 221 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.655324+0000 mon.a (mon.0) 2032 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]: dispatch 2021-01-27T09:33:02.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.669548+0000 mon.a (mon.0) 2033 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.671310+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:02.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:01 smithi103 bash[13570]: audit 2021-01-27T09:33:00.671910+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: audit 2021-01-27T09:33:01.665649+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:33:03.394 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: audit 2021-01-27T09:33:01.665761+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:33:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: cluster 2021-01-27T09:33:01.665811+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2021-01-27T09:33:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: audit 2021-01-27T09:33:01.667225+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: audit 2021-01-27T09:33:01.670356+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:03.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[13570]: audit 2021-01-27T09:33:01.671805+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:03.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: audit 2021-01-27T09:33:01.665649+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:33:03.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: audit 2021-01-27T09:33:01.665761+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:33:03.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: cluster 2021-01-27T09:33:01.665811+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2021-01-27T09:33:03.396 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: audit 2021-01-27T09:33:01.667225+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: audit 2021-01-27T09:33:01.670356+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:03.397 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:03 smithi103 bash[9772]: audit 2021-01-27T09:33:01.671805+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: audit 2021-01-27T09:33:01.665649+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_count","val": "2"}]': finished 2021-01-27T09:33:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: audit 2021-01-27T09:33:01.665761+0000 mon.a (mon.0) 2037 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:33:03.552 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: cluster 2021-01-27T09:33:01.665811+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2021-01-27T09:33:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: audit 2021-01-27T09:33:01.667225+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: audit 2021-01-27T09:33:01.670356+0000 mon.b (mon.2) 222 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:03.553 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:03 smithi047 bash[9721]: audit 2021-01-27T09:33:01.671805+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]: dispatch 2021-01-27T09:33:04.394 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[10018]: debug 2021-01-27T09:33:04.326+0000 7ff94e4ef700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T09:33:04.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: cluster 2021-01-27T09:33:02.478330+0000 mgr.y (mgr.14138) 669 : cluster [DBG] pgmap v729: 228 pgs: 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 4 op/s 2021-01-27T09:33:04.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.104500+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:33:04.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: cluster 2021-01-27T09:33:03.104707+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2021-01-27T09:33:04.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.105414+0000 mon.b (mon.2) 223 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.603 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.106569+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.603 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: cluster 2021-01-27T09:33:03.666469+0000 mon.a (mon.0) 2044 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:33:04.603 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.676784+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:04.603 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.676898+0000 mon.a (mon.0) 2046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:33:04.604 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: cluster 2021-01-27T09:33:03.677000+0000 mon.a (mon.0) 2047 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-01-27T09:33:04.604 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.679179+0000 mon.b (mon.2) 224 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:04.604 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[9772]: audit 2021-01-27T09:33:03.680595+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:04.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: cluster 2021-01-27T09:33:02.478330+0000 mgr.y (mgr.14138) 669 : cluster [DBG] pgmap v729: 228 pgs: 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 4 op/s 2021-01-27T09:33:04.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.104500+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:33:04.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: cluster 2021-01-27T09:33:03.104707+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2021-01-27T09:33:04.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.105414+0000 mon.b (mon.2) 223 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.106569+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: cluster 2021-01-27T09:33:03.666469+0000 mon.a (mon.0) 2044 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:33:04.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.676784+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:04.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.676898+0000 mon.a (mon.0) 2046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:33:04.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: cluster 2021-01-27T09:33:03.677000+0000 mon.a (mon.0) 2047 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-01-27T09:33:04.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.679179+0000 mon.b (mon.2) 224 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:04.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:04 smithi103 bash[13570]: audit 2021-01-27T09:33:03.680595+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:04.607 INFO:journalctl@ceph.iscsi.iscsi.a.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[22021]: debug mgr command failed -13 2021-01-27T09:33:04.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: cluster 2021-01-27T09:33:02.478330+0000 mgr.y (mgr.14138) 669 : cluster [DBG] pgmap v729: 228 pgs: 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 4 op/s 2021-01-27T09:33:04.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.104500+0000 mon.a (mon.0) 2041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_period","val": "600"}]': finished 2021-01-27T09:33:04.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: cluster 2021-01-27T09:33:03.104707+0000 mon.a (mon.0) 2042 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2021-01-27T09:33:04.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.105414+0000 mon.b (mon.2) 223 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.106569+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-01-27T09:33:04.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: cluster 2021-01-27T09:33:03.666469+0000 mon.a (mon.0) 2044 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-27T09:33:04.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.676784+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:04.610 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.676898+0000 mon.a (mon.0) 2046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_type","val": "bloom"}]': finished 2021-01-27T09:33:04.611 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: cluster 2021-01-27T09:33:03.677000+0000 mon.a (mon.0) 2047 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-01-27T09:33:04.611 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.679179+0000 mon.b (mon.2) 224 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:04.612 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:04 smithi047 bash[9721]: audit 2021-01-27T09:33:03.680595+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-01-27T09:33:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: audit 2021-01-27T09:33:04.332363+0000 mgr.y (mgr.14138) 670 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:33:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: cluster 2021-01-27T09:33:04.479455+0000 mgr.y (mgr.14138) 671 : cluster [DBG] pgmap v732: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T09:33:06.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: audit 2021-01-27T09:33:04.680071+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-01-27T09:33:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: cluster 2021-01-27T09:33:04.680575+0000 mon.a (mon.0) 2050 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-01-27T09:33:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: audit 2021-01-27T09:33:04.681477+0000 mon.b (mon.2) 225 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:06.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:05 smithi047 bash[9721]: audit 2021-01-27T09:33:04.682753+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:06.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: audit 2021-01-27T09:33:04.332363+0000 mgr.y (mgr.14138) 670 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:33:06.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: cluster 2021-01-27T09:33:04.479455+0000 mgr.y (mgr.14138) 671 : cluster [DBG] pgmap v732: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T09:33:06.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: audit 2021-01-27T09:33:04.680071+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-01-27T09:33:06.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: cluster 2021-01-27T09:33:04.680575+0000 mon.a (mon.0) 2050 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-01-27T09:33:06.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: audit 2021-01-27T09:33:04.681477+0000 mon.b (mon.2) 225 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:06.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[13570]: audit 2021-01-27T09:33:04.682753+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: audit 2021-01-27T09:33:04.332363+0000 mgr.y (mgr.14138) 670 : audit [INF] from='client.34445 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T09:33:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: cluster 2021-01-27T09:33:04.479455+0000 mgr.y (mgr.14138) 671 : cluster [DBG] pgmap v732: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T09:33:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: audit 2021-01-27T09:33:04.680071+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-01-27T09:33:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: cluster 2021-01-27T09:33:04.680575+0000 mon.a (mon.0) 2050 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-01-27T09:33:06.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: audit 2021-01-27T09:33:04.681477+0000 mon.b (mon.2) 225 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:06.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:05 smithi103 bash[9772]: audit 2021-01-27T09:33:04.682753+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-01-27T09:33:07.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:05.678390+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-01-27T09:33:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: cluster 2021-01-27T09:33:05.678620+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-01-27T09:33:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:05.680790+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:05.685912+0000 mon.b (mon.2) 226 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:05.693582+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:06.682732+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:06.683210+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]': finished 2021-01-27T09:33:07.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: cluster 2021-01-27T09:33:06.683452+0000 mon.a (mon.0) 2058 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-01-27T09:33:07.055 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:06 smithi047 bash[9721]: audit 2021-01-27T09:33:06.685337+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:07.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:05.678390+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-01-27T09:33:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: cluster 2021-01-27T09:33:05.678620+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-01-27T09:33:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:05.680790+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:07.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:05.685912+0000 mon.b (mon.2) 226 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:05.693582+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:06.682732+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:06.683210+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]': finished 2021-01-27T09:33:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: cluster 2021-01-27T09:33:06.683452+0000 mon.a (mon.0) 2058 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-01-27T09:33:07.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[9772]: audit 2021-01-27T09:33:06.685337+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:05.678390+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-01-27T09:33:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: cluster 2021-01-27T09:33:05.678620+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-01-27T09:33:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:05.680790+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:07.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:05.685912+0000 mon.b (mon.2) 226 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:05.693582+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-01-27T09:33:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:06.682732+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:06.683210+0000 mon.a (mon.0) 2057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi103-32354-45","var": "hit_set_search_last_n","val": "1"}]': finished 2021-01-27T09:33:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: cluster 2021-01-27T09:33:06.683452+0000 mon.a (mon.0) 2058 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-01-27T09:33:07.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:06 smithi103 bash[13570]: audit 2021-01-27T09:33:06.685337+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]: dispatch 2021-01-27T09:33:08.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:07 smithi047 bash[9721]: cluster 2021-01-27T09:33:06.480675+0000 mgr.y (mgr.14138) 672 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 339 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:33:08.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:07 smithi047 bash[9721]: audit 2021-01-27T09:33:06.761948+0000 mon.b (mon.2) 227 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:08.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:07 smithi047 bash[9721]: audit 2021-01-27T09:33:06.763348+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:08.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[9772]: cluster 2021-01-27T09:33:06.480675+0000 mgr.y (mgr.14138) 672 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 339 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:33:08.144 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[9772]: audit 2021-01-27T09:33:06.761948+0000 mon.b (mon.2) 227 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:08.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[9772]: audit 2021-01-27T09:33:06.763348+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:08.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[13570]: cluster 2021-01-27T09:33:06.480675+0000 mgr.y (mgr.14138) 672 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 339 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T09:33:08.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[13570]: audit 2021-01-27T09:33:06.761948+0000 mon.b (mon.2) 227 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:08.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:07 smithi103 bash[13570]: audit 2021-01-27T09:33:06.763348+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:09.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.690569+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:09.052 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.690836+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:33:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: cluster 2021-01-27T09:33:07.691191+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-01-27T09:33:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.693475+0000 mon.b (mon.2) 228 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.699262+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.053 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.712523+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.712987+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.714057+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.714528+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.715240+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:09.054 INFO:journalctl@ceph.mon.b.smithi047.stdout:Jan 27 09:33:08 smithi047 bash[9721]: audit 2021-01-27T09:33:07.715651+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.690569+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.690836+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:33:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: cluster 2021-01-27T09:33:07.691191+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-01-27T09:33:09.145 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.693475+0000 mon.b (mon.2) 228 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.699262+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.712523+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.712987+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.146 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.714057+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.714528+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.715240+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:09.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[9772]: audit 2021-01-27T09:33:07.715651+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:09.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.690569+0000 mon.a (mon.0) 2061 : audit [INF] from='client.? 172.21.15.103:0/2035304530' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-59"}]': finished 2021-01-27T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.690836+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]': finished 2021-01-27T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: cluster 2021-01-27T09:33:07.691191+0000 mon.a (mon.0) 2063 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-01-27T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.693475+0000 mon.b (mon.2) 228 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.699262+0000 mon.a (mon.0) 2064 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:09.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.712523+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.712987+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.714057+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.714528+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:09.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.715240+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:09.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:08 smithi103 bash[13570]: audit 2021-01-27T09:33:07.715651+0000 mon.a (mon.0) 2067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-27T09:33:25.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: cluster 2021-01-27T09:33:08.482200+0000 mgr.y (mgr.14138) 673 : cluster [DBG] pgmap v738: 228 pgs: 228 active+clean; 3.8 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-01-27T09:33:25.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.712985+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]': finished 2021-01-27T09:33:25.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.713116+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:33:25.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: cluster 2021-01-27T09:33:08.713206+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2021-01-27T09:33:25.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.715394+0000 mon.c (mon.1) 303 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:25.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.715900+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:25.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.756171+0000 mon.b (mon.2) 229 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:25.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.757457+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:25.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.757871+0000 mon.b (mon.2) 230 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:25.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[13570]: audit 2021-01-27T09:33:08.759023+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:25.147 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: cluster 2021-01-27T09:33:08.482200+0000 mgr.y (mgr.14138) 673 : cluster [DBG] pgmap v738: 228 pgs: 228 active+clean; 3.8 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-01-27T09:33:25.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.712985+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]': finished 2021-01-27T09:33:25.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.713116+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi103-32172-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-27T09:33:25.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: cluster 2021-01-27T09:33:08.713206+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2021-01-27T09:33:25.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.715394+0000 mon.c (mon.1) 303 : audit [INF] from='client.? 172.21.15.103:0/880737394' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:25.148 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.715900+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi103-32172-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi103-32172-60"}]: dispatch 2021-01-27T09:33:25.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.756171+0000 mon.b (mon.2) 229 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:25.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.757457+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi103-32354-6"}]: dispatch 2021-01-27T09:33:25.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.757871+0000 mon.b (mon.2) 230 : audit [INF] from='client.? 172.21.15.103:0/1455762144' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T09:33:25.149 INFO:journalctl@ceph.mon.a.smithi103.stdout:Jan 27 09:33:24 smithi103 bash[9772]: audit 2021-01-27T09:33:08.759023+0000 mon.a (mon.0) 2073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi103-32354-6", "tierpool": "test-rados-api-smithi103-32354-45"}]: dispatch 2021-01-27T21:03:34.478 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-27T21:03:34.509 DEBUG:teuthology.task.console_log:Killing console logger for smithi103 2021-01-27T21:03:34.510 DEBUG:teuthology.task.console_log:Killing console logger for smithi047 2021-01-27T21:03:34.511 DEBUG:teuthology.task.console_log:Killing console logger for smithi103 2021-01-27T21:03:34.511 DEBUG:teuthology.task.console_log:Killing console logger for smithi047 2021-01-27T21:03:34.512 DEBUG:teuthology.exit:Finished running handlers